Error reported in diagnostic logs. Please examine the log for more details

[jeffschwMSFT]

Build

https://dev.azure.com/dnceng/internal/_build/results?buildId=2367532

Error:

System.Net.Http.HttpRequestException: No route to host (dev.azure.com:443)
 ---> System.Net.Sockets.SocketException (65): No route to host
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token)
   at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|277_0(AwaitableSocketAsyncEventArgs saea, ValueTask connectTask, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at Microsoft.VisualStudio.Services.Common.VssHttpRetryMessageHandler.SendAsync(HttpRequestMessage request, CancellationToken cancellationToken)
   at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync(HttpRequestMessage message, HttpCompletionOption completionOption, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.VssHttpClientBase.SendAsync[T](HttpRequestMessage message, Object userState, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.Location.Client.LocationHttpClient.GetConnectionDataAsync(ConnectOptions connectOptions, Int64 lastChangeId, CancellationToken cancellationToken, Object userState)
   at Microsoft.VisualStudio.Services.WebApi.Location.VssServerDataProvider.GetConnectionDataAsync(ConnectOptions connectOptions, Int32 lastChangeId, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.WebApi.Location.VssServerDataProvider.ConnectAsync(ConnectOptions connectOptions, CancellationToken cancellationToken)
   at Microsoft.VisualStudio.Services.Agent.TaskServer.ConnectAsync(VssConnection jobConnection) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/TaskServer.cs:line 42
   at Microsoft.VisualStudio.Services.Agent.Worker.JobRunner.RunAsync(AgentJobRequestMessage message, CancellationToken jobRequestCancellationToken) in /Users/runner/work/1/s/src/Agent.Worker/JobRunner.cs:line 224
   at Microsoft.VisualStudio.Services.Agent.Worker.JobRunner.RunAsync(AgentJobRequestMessage message, CancellationToken jobRequestCancellationToken) in /Users/runner/work/1/s/src/Agent.Worker/JobRunner.cs:line 397
   at Microsoft.VisualStudio.Services.Agent.Worker.Worker.RunAsync(String pipeIn, String pipeOut) in /Users/runner/work/1/s/src/Agent.Worker/Worker.cs:line 97
   at Microsoft.VisualStudio.Services.Agent.Worker.Program.MainAsync(IHostContext context, String[] args) in /Users/runner/work/1/s/src/Agent.Worker/Program.cs:line 52

Error reported in diagnostic logs. Please examine the log for more details

Build leg reported

No response

Pull Request

No response

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "",
    "BuildRetry": false,
    "ErrorPattern": "Error reported in diagnostic logs. Please examine the log for more details",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng/internal/_build/results?buildId=2367532
Error message validated: Error reported in diagnostic logs. Please examine the log for more details
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/1/2024 3:50:06 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
855550	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#109259
855432	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#109278
854621	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#108702
854240	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading		dotnet/runtime#109261
854048	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#107465
853595	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading
853076	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#109079
2566664	dotnet-dotnet	AzureLinux_x64_Cross_Alpine_x64
850106	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#108999
850076	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#108636
848628	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading
848321	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading		dotnet/runtime#108876
847017	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#107769
846739	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#108968
842876	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading		dotnet/runtime#108876
2560687	dotnet-dotnet	AzureLinux_x64_Cross_x64
841039	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#102249
839110	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#108769
838971	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#108764
2557030	dotnet-runtime	tvossimulator-x64 release NativeAOT
836097	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#108629
2556047	dotnet-dotnet	AzureLinux_x64_Cross_Alpine_arm
2555145	dotnet-dotnet	AzureLinux_x64_Cross_Mono_arm
829750	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#108535
828516	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#108575
828351	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#108514
828229	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#108535
828198	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#108247
827705	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#108497
826861	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#108537
826023	dotnet/runtime	browser-wasm linux Release LibraryTests_Threading		dotnet/runtime#108481
2551618	dotnet-runtime	iossimulator-x64 release NativeAOT	Log
2550964	dotnet-runtime	Libraries SuperPMI collection libraries_tests_no_tiered_compilation Checked coreclr osx arm64 Release	Log
823893	dotnet/runtime	linux-x64 debug Libraries_AllConfigurations		dotnet/runtime#108449
823583	dotnet/runtime	browser-wasm linux Release LibraryTests		dotnet/runtime#108425
2550262	dotnet-runtime	osx-x64 release CoreCLR	Log

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	7	36

[lewing]

Looks like mostly macs? not sure where Build Source Index runs

[epananth]

Looked at the latest builds all are failing cos out of space on the device

[epananth]

##[error]Error reported in diagnostic logs. Please examine the log for more details. - /Users/runner/runners/3.242.1/_diag/Worker_20240806-221514-utc.log System.IO.IOException: No space left on device : '/Users/runner/runners/3.242.1/_diag/Worker_20240806-221514-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan1 buffer, Int64 fileOffset)
at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite()
at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder)
at System.Diagnostics.TextWriterTraceListener.Flush()
at Microsoft.VisualStudio.Services.Agent.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/HostTraceListener.cs:line 151
at Microsoft.VisualStudio.Services.Agent.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) in /Users/runner/work/1/s/src/Microsoft.VisualStudio.Services.Agent/HostTraceListener.cs:line 81
at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message)
at Microsoft.VisualStudio.Services.Agent.Worker.Worker.RunAsync(String pipeIn, String pipeOut) in /Users/runner/work/1/s/src/Agent.Worker/Worker.cs:line 93
at Microsoft.VisualStudio.Services.Agent.Worker.Program.MainAsync(IHostContext context, String[] args) in /Users/runner/work/1/s/src/Agent.Worker/Program.cs:line 52`

[epananth]

I am going to go ahead an add a check for disk utilization, to know more why this is failing.

[epananth]

Is it possible to add this check to your pipeline to get more data (like aspnet-core team did)

https://github.com/dotnet/aspnetcore/blob/42af9fe6ddd7c3f9cde04ac003bf97509881873b/.azure/pipelines/jobs/default-build.yml#L163-L165