Jul 06 17:36:34.900282 ip-10-0-137-203 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 17:36:34.900296 ip-10-0-137-203 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 17:36:34.900305 ip-10-0-137-203 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 17:36:34.900795 ip-10-0-137-203 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 17:36:46.060192 ip-10-0-137-203 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 17:36:46.060207 ip-10-0-137-203 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0f1ff593858c4e35a2becf0890054bdb -- Jul 06 17:38:49.659017 ip-10-0-137-203 systemd[1]: Starting Kubernetes Kubelet... Jul 06 17:38:50.022888 ip-10-0-137-203 kubenswrapper[2539]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:38:50.022888 ip-10-0-137-203 kubenswrapper[2539]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 17:38:50.022888 ip-10-0-137-203 kubenswrapper[2539]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:38:50.022888 ip-10-0-137-203 kubenswrapper[2539]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 17:38:50.022888 ip-10-0-137-203 kubenswrapper[2539]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 17:38:50.023567 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.022900 2539 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 17:38:50.029251 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029224 2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:38:50.029251 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029244 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:38:50.029251 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029248 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:38:50.029251 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029251 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:38:50.029251 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029255 2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029259 2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029264 2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029267 2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029271 2539 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029274 2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029277 2539 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029280 2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029282 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029286 2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029289 2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029291 2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029294 2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029297 2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029299 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029302 2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029305 2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029308 2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029310 2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:38:50.029453 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029312 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029315 2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029318 2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029320 2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029323 2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029325 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029328 2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029331 2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029334 2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029336 2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029339 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029341 2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029344 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029346 2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029349 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029354 2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029358 2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029361 2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029363 2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:38:50.029933 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029366 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029368 2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029371 2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029374 2539 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029378 2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029381 2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029384 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029387 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029391 2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029394 2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029396 2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029399 2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029401 2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029404 2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029406 2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029409 2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029412 2539 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029414 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029417 2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:38:50.030415 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029420 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029422 2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029425 2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029427 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029430 2539 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029432 2539 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029435 2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029437 2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029440 2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029443 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029446 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029449 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029451 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029454 2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029456 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029459 2539 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029462 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029464 2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029467 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029470 2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:38:50.030891 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029473 2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029475 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029479 2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029481 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029484 2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029487 2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029490 2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029492 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029495 2539 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029497 2539 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029500 2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029502 2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029505 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029507 2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029510 2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029512 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029515 2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:38:50.031370 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.029517 2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031587 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031595 2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031598 2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031603 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031606 2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031609 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031612 2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031614 2539 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031617 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031620 2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031622 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031625 2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031628 2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031630 2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031633 2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031635 2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031638 2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031641 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031644 2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:38:50.031793 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031648 2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031652 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031654 2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031657 2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031659 2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031662 2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031664 2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031667 2539 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031669 2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031672 2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031674 2539 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031677 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031679 2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031681 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031685 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031688 2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031691 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031716 2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031721 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:38:50.032274 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031726 2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031729 2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031732 2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031735 2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031738 2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031741 2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031744 2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031747 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031749 2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031752 2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031754 2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031757 2539 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031760 2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031762 2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031765 2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031768 2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031771 2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031774 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031776 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031779 2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:38:50.032741 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031781 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031783 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031786 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031789 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031791 2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031794 2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031796 2539 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031800 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031803 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031805 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031808 2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031810 2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031813 2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031816 2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031818 2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031821 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031823 2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031826 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031828 2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031831 2539 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:38:50.033260 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031833 2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031836 2539 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031838 2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031841 2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031844 2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031847 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031849 2539 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031852 2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031855 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031857 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031860 2539 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031862 2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031865 2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031867 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031870 2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031872 2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031875 2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031877 2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031880 2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031883 2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:38:50.033771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.031886 2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032273 2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032278 2539 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032281 2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032284 2539 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032286 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032289 2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032291 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032294 2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032297 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032299 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032302 2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032305 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032307 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032310 2539 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032313 2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032315 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032319 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032321 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032324 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:38:50.034266 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032326 2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032329 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032332 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032335 2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032337 2539 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032340 2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032343 2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032346 2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032348 2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032351 2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032353 2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032356 2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032359 2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032361 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032364 2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032366 2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032369 2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032371 2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032374 2539 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032377 2539 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:38:50.034775 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032379 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032382 2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032384 2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032387 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032389 2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032391 2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032394 2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032397 2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032399 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032403 2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032408 2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032410 2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032413 2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032415 2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032418 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032420 2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032422 2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032425 2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032429 2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:38:50.035255 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032433 2539 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032435 2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032439 2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032441 2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032444 2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032447 2539 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032450 2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032452 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032456 2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032459 2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032462 2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032464 2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032467 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032470 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032472 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032475 2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032477 2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032479 2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032482 2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032485 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:38:50.035719 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032487 2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032490 2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032492 2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032494 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032498 2539 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032500 2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032504 2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032507 2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032510 2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032513 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032516 2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032518 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032521 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032523 2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032526 2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032529 2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032532 2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032534 2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032537 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:38:50.036194 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032539 2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.032542 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032612 2539 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032619 2539 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032626 2539 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032631 2539 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032635 2539 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032639 2539 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032643 2539 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032647 2539 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032650 2539 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032653 2539 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032656 2539 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032659 2539 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032662 2539 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032665 2539 flags.go:64] FLAG: --cgroup-root="" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032668 2539 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032671 2539 flags.go:64] FLAG: --client-ca-file="" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032674 2539 flags.go:64] FLAG: --cloud-provider="external" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032677 2539 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032682 2539 flags.go:64] FLAG: --cluster-domain="" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032685 2539 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032688 2539 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032691 2539 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 17:38:50.036640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032708 2539 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032712 2539 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032715 2539 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032718 2539 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032722 2539 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032726 2539 flags.go:64] FLAG: --contention-profiling="false" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032729 2539 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032732 2539 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032735 2539 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032737 2539 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032741 2539 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032745 2539 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032751 2539 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032754 2539 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032757 2539 flags.go:64] FLAG: --enable-server="true" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032760 2539 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032764 2539 flags.go:64] FLAG: --event-burst="100" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032767 2539 flags.go:64] FLAG: --event-qps="50" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032770 2539 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032773 2539 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032775 2539 flags.go:64] FLAG: --eviction-hard="" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032780 2539 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032782 2539 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032786 2539 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032789 2539 flags.go:64] FLAG: --eviction-soft="" Jul 06 17:38:50.037230 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032791 2539 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032794 2539 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032799 2539 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032802 2539 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032804 2539 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032807 2539 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032810 2539 flags.go:64] FLAG: --feature-gates="" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032813 2539 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032816 2539 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032820 2539 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032822 2539 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032827 2539 flags.go:64] FLAG: --healthz-port="10248" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032830 2539 flags.go:64] FLAG: --help="false" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032833 2539 flags.go:64] FLAG: --hostname-override="ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032837 2539 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032839 2539 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032843 2539 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032846 2539 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032849 2539 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032853 2539 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032856 2539 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032859 2539 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032861 2539 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 17:38:50.037838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032864 2539 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032867 2539 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032870 2539 flags.go:64] FLAG: --kube-reserved="" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032873 2539 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032876 2539 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032878 2539 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032882 2539 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032884 2539 flags.go:64] FLAG: --lock-file="" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032887 2539 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032890 2539 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032893 2539 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032898 2539 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032904 2539 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032907 2539 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032909 2539 flags.go:64] FLAG: --logging-format="text" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032912 2539 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032915 2539 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032918 2539 flags.go:64] FLAG: --manifest-url="" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032920 2539 flags.go:64] FLAG: --manifest-url-header="" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032924 2539 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032929 2539 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032933 2539 flags.go:64] FLAG: --max-pods="110" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032936 2539 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032939 2539 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032941 2539 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 17:38:50.038457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032944 2539 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032947 2539 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032950 2539 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032954 2539 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032962 2539 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032965 2539 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032968 2539 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032971 2539 flags.go:64] FLAG: --pod-cidr="" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032974 2539 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032980 2539 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032983 2539 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032986 2539 flags.go:64] FLAG: --pods-per-core="0" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032989 2539 flags.go:64] FLAG: --port="10250" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032992 2539 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032995 2539 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d1859cf6cc25f3d9" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.032998 2539 flags.go:64] FLAG: --qos-reserved="" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033001 2539 flags.go:64] FLAG: --read-only-port="10255" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033004 2539 flags.go:64] FLAG: --register-node="true" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033007 2539 flags.go:64] FLAG: --register-with-taints="" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033010 2539 flags.go:64] FLAG: --registry-burst="10" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033013 2539 flags.go:64] FLAG: --registry-qps="5" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033016 2539 flags.go:64] FLAG: --reserved-cpus="" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033019 2539 flags.go:64] FLAG: --reserved-memory="" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033023 2539 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033026 2539 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 17:38:50.039067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033029 2539 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033032 2539 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033035 2539 flags.go:64] FLAG: --runonce="false" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033039 2539 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033042 2539 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033045 2539 flags.go:64] FLAG: --seccomp-default="false" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033048 2539 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033051 2539 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033054 2539 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033057 2539 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033061 2539 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033064 2539 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033067 2539 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033069 2539 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033072 2539 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033075 2539 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033078 2539 flags.go:64] FLAG: --system-cgroups="" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033081 2539 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033086 2539 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033089 2539 flags.go:64] FLAG: --tls-cert-file="" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033092 2539 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033096 2539 flags.go:64] FLAG: --tls-min-version="" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033099 2539 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033102 2539 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033104 2539 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 17:38:50.039692 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033107 2539 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033110 2539 flags.go:64] FLAG: --v="2" Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033114 2539 flags.go:64] FLAG: --version="false" Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033118 2539 flags.go:64] FLAG: --vmodule="" Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033122 2539 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.033125 2539 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033259 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033263 2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033267 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033270 2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033274 2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033277 2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033280 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033283 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033285 2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033288 2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033290 2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033295 2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033298 2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033300 2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033303 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:38:50.040773 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033307 2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033311 2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033314 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033316 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033319 2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033322 2539 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033324 2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033327 2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033330 2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033332 2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033335 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033337 2539 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033340 2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033342 2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033345 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033348 2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033351 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033353 2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033356 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033359 2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:38:50.041647 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033361 2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033365 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033368 2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033370 2539 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033373 2539 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033376 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033378 2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033381 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033385 2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033387 2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033390 2539 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033393 2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033395 2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033398 2539 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033400 2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033403 2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033405 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033408 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033410 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033413 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:38:50.042521 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033415 2539 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033418 2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033422 2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033425 2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033428 2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033431 2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033434 2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033437 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033439 2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033442 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033444 2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033447 2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033450 2539 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033454 2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033457 2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033459 2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033462 2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033465 2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033467 2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:38:50.043430 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033470 2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033475 2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033478 2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033481 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033484 2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033487 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033490 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033492 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033495 2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033498 2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033500 2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033502 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033505 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033508 2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033510 2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033513 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033515 2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033517 2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033520 2539 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:38:50.043993 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033523 2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033525 2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033528 2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033531 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033533 2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.033536 2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.034166 2539 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.041973 2539 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.041993 2539 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.042012 2539 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.042021 2539 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042116 2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042124 2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042129 2539 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042133 2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:38:50.044607 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042138 2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042143 2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042148 2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042153 2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042157 2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042162 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042167 2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042171 2539 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042176 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042180 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042184 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042188 2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042192 2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042197 2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042201 2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042205 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042209 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042213 2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042217 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042221 2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:38:50.045269 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042226 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042230 2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042234 2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042239 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042243 2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042250 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042254 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042258 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042263 2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042267 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042271 2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042275 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042280 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042285 2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042289 2539 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042293 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042297 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042301 2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042305 2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:38:50.045978 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042310 2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042314 2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042319 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042323 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042328 2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042332 2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042336 2539 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042340 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042344 2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042348 2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042352 2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042356 2539 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042360 2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042364 2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042368 2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042373 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042378 2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042382 2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042388 2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042393 2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:38:50.046572 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042397 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042402 2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042408 2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042415 2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042419 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042424 2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042428 2539 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042433 2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042437 2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042441 2539 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042445 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042449 2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042455 2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042461 2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042466 2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042470 2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042476 2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042481 2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042486 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:38:50.047315 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042491 2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042496 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042500 2539 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042505 2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042509 2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042514 2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042517 2539 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042522 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042525 2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042529 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042534 2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042539 2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042543 2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042548 2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042553 2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042557 2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:38:50.047995 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042561 2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.042569 2539 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042771 2539 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042781 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042787 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042792 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042797 2539 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042802 2539 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042806 2539 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042811 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042816 2539 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042820 2539 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042824 2539 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042828 2539 feature_gate.go:328] unrecognized feature gate: Example Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042833 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 17:38:50.048386 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042837 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042841 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042846 2539 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042850 2539 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042855 2539 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042859 2539 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042863 2539 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042867 2539 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042872 2539 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042876 2539 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042880 2539 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042885 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042889 2539 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042893 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042897 2539 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042903 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042907 2539 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042911 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042916 2539 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042920 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 17:38:50.048837 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042924 2539 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042928 2539 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042932 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042936 2539 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042940 2539 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042944 2539 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042948 2539 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042952 2539 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042957 2539 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042961 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042965 2539 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042971 2539 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042978 2539 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042984 2539 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042989 2539 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042994 2539 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.042998 2539 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043003 2539 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043007 2539 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 17:38:50.049316 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043012 2539 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043016 2539 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043020 2539 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043025 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043029 2539 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043033 2539 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043038 2539 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043043 2539 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043047 2539 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043052 2539 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043056 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043060 2539 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043064 2539 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043069 2539 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043073 2539 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043077 2539 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043082 2539 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043086 2539 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043090 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043094 2539 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 17:38:50.049826 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043098 2539 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043102 2539 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043106 2539 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043110 2539 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043114 2539 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043118 2539 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043123 2539 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043128 2539 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043132 2539 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043136 2539 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043140 2539 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043144 2539 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043148 2539 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043152 2539 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043156 2539 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043160 2539 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043165 2539 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043169 2539 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043173 2539 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043177 2539 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 17:38:50.050487 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043181 2539 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043188 2539 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043193 2539 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043198 2539 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043203 2539 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043208 2539 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:50.043213 2539 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.043221 2539 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.043390 2539 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.046264 2539 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.047840 2539 server.go:1019] "Starting client certificate rotation" Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.047953 2539 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.047987 2539 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 17:38:50.051342 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.050779 2539 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 17:38:50.054492 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.054465 2539 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 17:38:50.065226 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.065209 2539 log.go:25] "Validated CRI v1 runtime API" Jul 06 17:38:50.067347 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.067329 2539 log.go:25] "Validated CRI v1 image API" Jul 06 17:38:50.068250 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.068222 2539 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 17:38:50.073455 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.073430 2539 fs.go:135] Filesystem UUIDs: map[522c7f1a-571e-4620-975f-e2160e51cc3e:/dev/nvme0n1p4 75a6d28c-efaf-4c34-8015-4b1fa7fbe632:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 06 17:38:50.073542 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.073453 2539 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 17:38:50.078677 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.078558 2539 manager.go:216] Machine: {Timestamp:2026-07-06 17:38:50.077258596 +0000 UTC m=+0.308503763 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100752 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22df395e7b9c6f9819728f380a7422 SystemUUID:ec22df39-5e7b-9c6f-9819-728f380a7422 BootID:0f1ff593-858c-4e35-a2be-cf0890054bdb Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:4e:71:27:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:4e:71:27:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:40:a8:51:b8:54 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 17:38:50.078677 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.078664 2539 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 17:38:50.078860 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.078787 2539 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 17:38:50.081492 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.081476 2539 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 17:38:50.081900 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.081876 2539 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 17:38:50.082047 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.081905 2539 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-203.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 17:38:50.082628 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.082619 2539 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 17:38:50.082660 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.082631 2539 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 17:38:50.082660 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.082639 2539 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 17:38:50.083220 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.083209 2539 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 17:38:50.084444 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.084434 2539 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 17:38:50.087218 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.087204 2539 state_mem.go:36] "Initialized new in-memory state store" Jul 06 17:38:50.087341 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.087332 2539 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 17:38:50.087380 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.087366 2539 kubelet.go:486] "Attempting to sync node with API server" Jul 06 17:38:50.087380 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.087379 2539 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 17:38:50.087433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.087393 2539 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 17:38:50.087433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.087402 2539 kubelet.go:398] "Adding apiserver pod source" Jul 06 17:38:50.087433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.087413 2539 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 17:38:50.087816 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.087804 2539 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 17:38:50.087850 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.087824 2539 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 17:38:50.089945 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.089927 2539 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 17:38:50.092649 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.092599 2539 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 17:38:50.092761 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.092665 2539 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093843 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093866 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093875 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093891 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093905 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093915 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093928 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093937 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093948 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093957 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093969 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 17:38:50.094144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.093978 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 17:38:50.094866 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.094851 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 17:38:50.094907 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.094881 2539 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 17:38:50.098820 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.098796 2539 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 17:38:50.098820 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.098802 2539 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-203.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 17:38:50.098928 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.098831 2539 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-203.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 17:38:50.098928 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.098921 2539 server.go:1268] "Started kubelet" Jul 06 17:38:50.099184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.099001 2539 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 17:38:50.099184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.099019 2539 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 17:38:50.099184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.099047 2539 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 17:38:50.099997 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.099970 2539 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nf8bk" Jul 06 17:38:50.099983 ip-10-0-137-203 systemd[1]: Started Kubernetes Kubelet. Jul 06 17:38:50.100515 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.100471 2539 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 17:38:50.101027 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.101009 2539 server.go:310] "Adding debug handlers to kubelet server" Jul 06 17:38:50.105553 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.105534 2539 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 17:38:50.107440 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.107427 2539 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 17:38:50.107515 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.107446 2539 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 17:38:50.107563 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.107523 2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:50.108601 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108000 2539 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 17:38:50.108601 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108333 2539 factory.go:55] Registering systemd factory Jul 06 17:38:50.108601 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108510 2539 factory.go:223] Registration of the systemd container factory successfully Jul 06 17:38:50.108601 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108519 2539 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 17:38:50.108601 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108533 2539 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 17:38:50.108995 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108617 2539 reconstruct.go:97] "Volume reconstruction finished" Jul 06 17:38:50.108995 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108624 2539 reconciler.go:29] "Reconciler: start to sync state" Jul 06 17:38:50.108995 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108758 2539 factory.go:153] Registering CRI-O factory Jul 06 17:38:50.108995 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108773 2539 factory.go:223] Registration of the crio container factory successfully Jul 06 17:38:50.108995 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108864 2539 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 17:38:50.108995 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108888 2539 factory.go:103] Registering Raw factory Jul 06 17:38:50.108995 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.108904 2539 manager.go:1196] Started watching for new ooms in manager Jul 06 17:38:50.109468 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.109188 2539 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nf8bk" Jul 06 17:38:50.109468 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.109290 2539 manager.go:349] Starting recovery of all containers Jul 06 17:38:50.110345 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.108948 2539 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-203.ec2.internal.18bfc40b4259fefb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-203.ec2.internal,UID:ip-10-0-137-203.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-203.ec2.internal,},FirstTimestamp:2026-07-06 17:38:50.098884347 +0000 UTC m=+0.330129516,LastTimestamp:2026-07-06 17:38:50.098884347 +0000 UTC m=+0.330129516,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-203.ec2.internal,}" Jul 06 17:38:50.119244 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.119226 2539 manager.go:354] Recovery completed Jul 06 17:38:50.120457 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.120414 2539 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:38:50.121436 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.121404 2539 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 06 17:38:50.124481 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.124452 2539 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-203.ec2.internal\" not found" node="ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.124630 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.124619 2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:38:50.126623 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.126606 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:38:50.126689 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.126638 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:38:50.126755 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.126721 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:38:50.127340 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.127326 2539 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 17:38:50.127340 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.127339 2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:38:50.127479 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.127338 2539 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 17:38:50.127479 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.127372 2539 state_mem.go:36] "Initialized new in-memory state store" Jul 06 17:38:50.128070 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.128056 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:38:50.128131 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.128084 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:38:50.128131 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.128099 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:38:50.128625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.128612 2539 policy_none.go:49] "None policy: Start" Jul 06 17:38:50.128683 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.128632 2539 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 17:38:50.128683 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.128647 2539 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 17:38:50.129731 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.129690 2539 policy_none.go:47] "Start" Jul 06 17:38:50.171477 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.171454 2539 manager.go:337] "Starting Device Plugin manager" Jul 06 17:38:50.171606 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.171497 2539 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 17:38:50.171606 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.171511 2539 server.go:87] "Starting device plugin registration server" Jul 06 17:38:50.171886 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.171874 2539 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 17:38:50.171927 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.171887 2539 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 17:38:50.172011 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.171992 2539 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 17:38:50.172101 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.172085 2539 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 17:38:50.172101 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.172098 2539 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 17:38:50.172722 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.172680 2539 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 17:38:50.172804 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.172762 2539 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:50.272973 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.272901 2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:38:50.274497 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.274257 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:38:50.274497 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.274288 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:38:50.274497 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.274298 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:38:50.274497 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.274342 2539 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.279928 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.279910 2539 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.279983 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.279935 2539 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-203.ec2.internal\": node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:50.293141 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.293114 2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:50.296262 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.296229 2539 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 17:38:50.297762 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.297741 2539 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 17:38:50.297837 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.297777 2539 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 17:38:50.297837 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.297798 2539 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 17:38:50.297921 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.297837 2539 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 17:38:50.300318 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.300299 2539 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:38:50.394284 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.394249 2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:50.398390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.398367 2539 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal"] Jul 06 17:38:50.398450 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.398441 2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:38:50.400265 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.400248 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:38:50.400362 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.400281 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:38:50.400362 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.400296 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:38:50.401495 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.401481 2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:38:50.401625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.401611 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.401684 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.401643 2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:38:50.402267 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.402251 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:38:50.402354 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.402274 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:38:50.402354 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.402286 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:38:50.402354 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.402316 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:38:50.402354 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.402341 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:38:50.402354 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.402355 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:38:50.403652 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.403637 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.403752 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.403667 2539 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 17:38:50.405372 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.405235 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientMemory" Jul 06 17:38:50.405372 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.405264 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 17:38:50.405372 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.405276 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeHasSufficientPID" Jul 06 17:38:50.410136 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.410113 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/096de2595b7c83568a62cfe98f27c518-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"096de2595b7c83568a62cfe98f27c518\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.410222 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.410157 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/096de2595b7c83568a62cfe98f27c518-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"096de2595b7c83568a62cfe98f27c518\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.410222 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.410180 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b7813548906f23d840a9a9ca553f805-config\") pod \"kube-apiserver-proxy-ip-10-0-137-203.ec2.internal\" (UID: \"5b7813548906f23d840a9a9ca553f805\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.422315 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.422287 2539 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-203.ec2.internal\" not found" node="ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.424552 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.424534 2539 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-203.ec2.internal\" not found" node="ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.494501 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.494468 2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:50.510447 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.510421 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b7813548906f23d840a9a9ca553f805-config\") pod \"kube-apiserver-proxy-ip-10-0-137-203.ec2.internal\" (UID: \"5b7813548906f23d840a9a9ca553f805\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.510521 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.510452 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/096de2595b7c83568a62cfe98f27c518-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"096de2595b7c83568a62cfe98f27c518\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.510521 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.510472 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/096de2595b7c83568a62cfe98f27c518-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"096de2595b7c83568a62cfe98f27c518\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.510521 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.510519 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/096de2595b7c83568a62cfe98f27c518-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"096de2595b7c83568a62cfe98f27c518\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.510614 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.510531 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5b7813548906f23d840a9a9ca553f805-config\") pod \"kube-apiserver-proxy-ip-10-0-137-203.ec2.internal\" (UID: \"5b7813548906f23d840a9a9ca553f805\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.510614 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.510539 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/096de2595b7c83568a62cfe98f27c518-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal\" (UID: \"096de2595b7c83568a62cfe98f27c518\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.595495 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.595427 2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:50.695965 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.695934 2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:50.725424 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.725387 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.727525 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:50.727506 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jul 06 17:38:50.796835 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.796791 2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:50.897396 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.897320 2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:50.997891 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:50.997853 2539 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-203.ec2.internal\" not found" Jul 06 17:38:51.038149 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.038119 2539 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:38:51.047405 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.047389 2539 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 17:38:51.047515 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.047499 2539 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 17:38:51.047574 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.047547 2539 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 17:38:51.047605 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.047547 2539 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 17:38:51.087739 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.087710 2539 apiserver.go:52] "Watching apiserver" Jul 06 17:38:51.108012 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.107978 2539 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 17:38:51.108190 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.107978 2539 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" Jul 06 17:38:51.108492 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.108469 2539 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 17:38:51.114618 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.113421 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-jqmtq","openshift-multus/network-metrics-daemon-dpd7c","openshift-network-diagnostics/network-check-target-jf4ln","openshift-ovn-kubernetes/ovnkube-node-rcbtm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7","openshift-cluster-node-tuning-operator/tuned-6hkjj","openshift-dns/node-resolver-pjllx","openshift-image-registry/node-ca-gx4hg","openshift-multus/multus-additional-cni-plugins-xq8hn","openshift-network-operator/iptables-alerter-88p55","kube-system/global-pull-secret-syncer-kd4d2","kube-system/konnectivity-agent-drkkl"] Jul 06 17:38:51.114795 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.114656 2539 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 17:33:50 +0000 UTC" deadline="2028-03-13 18:00:02.548779906 +0000 UTC" Jul 06 17:38:51.114795 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.114707 2539 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14784h21m11.434077639s" Jul 06 17:38:51.115511 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.115494 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.117004 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.116985 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:51.117111 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.117065 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:38:51.118552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.118528 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 17:38:51.118653 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.118539 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 17:38:51.118653 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.118593 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 17:38:51.118792 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.118713 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5x2vf\"" Jul 06 17:38:51.118834 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.118723 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 17:38:51.119499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.119479 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:51.119594 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.119553 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:38:51.121303 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.121288 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.122763 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.122745 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.123921 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.123893 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kbcgn\"" Jul 06 17:38:51.124028 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.123938 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 17:38:51.124028 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.123944 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 17:38:51.124294 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.124280 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 17:38:51.124648 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.124628 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.125486 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.125447 2539 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 17:38:51.125581 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.125533 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 17:38:51.125581 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.125546 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 17:38:51.125581 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.125565 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 17:38:51.125733 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.125583 2539 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" Jul 06 17:38:51.126099 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.125936 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 17:38:51.126099 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.125937 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 17:38:51.126099 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.125998 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 17:38:51.126099 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.126023 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bvc2m\"" Jul 06 17:38:51.126542 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.126525 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.127216 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.127197 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tdvgl\"" Jul 06 17:38:51.127350 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.127233 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 17:38:51.127350 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.127258 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:38:51.128087 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.128066 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.129203 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.129181 2539 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 17:38:51.130089 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.129970 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.130089 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.130072 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hswb7\"" Jul 06 17:38:51.130389 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.130373 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 17:38:51.130793 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.130772 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 17:38:51.130887 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.130774 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d8f58\"" Jul 06 17:38:51.130887 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.130775 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 17:38:51.130887 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.130816 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 17:38:51.130887 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.130811 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 17:38:51.131666 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.131645 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.132852 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.132832 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 17:38:51.133268 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.133248 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:51.133359 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.133275 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7b8qq\"" Jul 06 17:38:51.133359 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.133328 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:38:51.133480 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.133413 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 17:38:51.134441 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.134421 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 17:38:51.134441 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.134433 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 17:38:51.134557 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.134456 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:38:51.134557 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.134536 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hvx7m\"" Jul 06 17:38:51.134995 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.134968 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal"] Jul 06 17:38:51.135110 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.135095 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:38:51.138057 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.137525 2539 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 17:38:51.138057 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.137850 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal"] Jul 06 17:38:51.138205 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.138093 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 17:38:51.138294 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.138273 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 17:38:51.138359 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.138346 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n7npx\"" Jul 06 17:38:51.146191 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.146171 2539 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mz8dh" Jul 06 17:38:51.154390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.154328 2539 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mz8dh" Jul 06 17:38:51.209121 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.209094 2539 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 17:38:51.215120 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215095 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70aaad28-a30e-4bb0-8919-df1cbb7c0ea9-konnectivity-ca\") pod \"konnectivity-agent-drkkl\" (UID: \"70aaad28-a30e-4bb0-8919-df1cbb7c0ea9\") " pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:38:51.215120 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215124 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x59x8\" (UniqueName: \"kubernetes.io/projected/dda9101d-ad36-4d77-8169-2d8b7524075b-kube-api-access-x59x8\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.215344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215144 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.215344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215160 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a46359ec-0a2a-464a-9f12-9997480a91a3-ovnkube-config\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.215344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215181 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-cnibin\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.215344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215211 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/787a3934-5d38-4057-99a1-3332f7da451d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.215344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215248 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-cnibin\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.215344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215275 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-kubelet\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.215344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215295 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-systemd\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.215344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215337 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-sys\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215380 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e758f834-160a-40f4-a469-520979a5e4c7-dbus\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215400 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-os-release\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215416 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-run-k8s-cni-cncf-io\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215431 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/515b9eac-60b8-41e5-b125-1605a93e7612-etc-tuned\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215446 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-var-lib-cni-multus\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215491 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-node-log\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215528 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qshml\" (UniqueName: \"kubernetes.io/projected/515b9eac-60b8-41e5-b125-1605a93e7612-kube-api-access-qshml\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215567 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-device-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215598 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/787a3934-5d38-4057-99a1-3332f7da451d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215626 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-host\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215651 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eba56436-f6d7-4268-a036-476e9da0943e-hosts-file\") pod \"node-resolver-pjllx\" (UID: \"eba56436-f6d7-4268-a036-476e9da0943e\") " pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.215725 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215676 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-cni-dir\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215705 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-run-netns\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215762 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-var-lib-openvswitch\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215791 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215819 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a46359ec-0a2a-464a-9f12-9997480a91a3-ovn-node-metrics-cert\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215842 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-modprobe-d\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215867 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-kubernetes\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215892 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57320a61-81a7-4f23-8a83-6f97dd7a07b2-iptables-alerter-script\") pod \"iptables-alerter-88p55\" (UID: \"57320a61-81a7-4f23-8a83-6f97dd7a07b2\") " pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215920 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-run-openvswitch\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215949 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-cni-netd\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215969 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a46359ec-0a2a-464a-9f12-9997480a91a3-ovnkube-script-lib\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.215985 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-var-lib-kubelet\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216000 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57320a61-81a7-4f23-8a83-6f97dd7a07b2-host-slash\") pod \"iptables-alerter-88p55\" (UID: \"57320a61-81a7-4f23-8a83-6f97dd7a07b2\") " pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216015 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-socket-dir-parent\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216031 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-daemon-config\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216046 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-run-systemd\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.216259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216084 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e758f834-160a-40f4-a469-520979a5e4c7-kubelet-config\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216109 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216125 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-etc-selinux\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216143 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216179 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-etc-kubernetes\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216196 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a46359ec-0a2a-464a-9f12-9997480a91a3-env-overrides\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216211 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/515b9eac-60b8-41e5-b125-1605a93e7612-tmp\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216228 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-os-release\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216244 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-run-ovn\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216268 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eba56436-f6d7-4268-a036-476e9da0943e-tmp-dir\") pod \"node-resolver-pjllx\" (UID: \"eba56436-f6d7-4268-a036-476e9da0943e\") " pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216291 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216323 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdzb9\" (UniqueName: \"kubernetes.io/projected/a31b714e-0b4b-4193-baf1-4473afd54463-kube-api-access-rdzb9\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216370 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70aaad28-a30e-4bb0-8919-df1cbb7c0ea9-agent-certs\") pod \"konnectivity-agent-drkkl\" (UID: \"70aaad28-a30e-4bb0-8919-df1cbb7c0ea9\") " pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216391 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-var-lib-cni-bin\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216406 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-hostroot\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216422 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-run-multus-certs\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216436 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-systemd-units\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.216806 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216451 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-sysctl-conf\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216466 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdcvm\" (UniqueName: \"kubernetes.io/projected/57320a61-81a7-4f23-8a83-6f97dd7a07b2-kube-api-access-sdcvm\") pod \"iptables-alerter-88p55\" (UID: \"57320a61-81a7-4f23-8a83-6f97dd7a07b2\") " pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216482 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb8d8\" (UniqueName: \"kubernetes.io/projected/3f8fc970-c51f-449e-aa11-776bcca8d167-kube-api-access-zb8d8\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216497 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dda9101d-ad36-4d77-8169-2d8b7524075b-cni-binary-copy\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216512 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-log-socket\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216527 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-cni-bin\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216554 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-run\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216575 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-sys-fs\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216591 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-system-cni-dir\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216621 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/787a3934-5d38-4057-99a1-3332f7da451d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216651 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-etc-openvswitch\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216667 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-sysctl-d\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216686 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216757 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a4e159e-96e1-4c0c-a18c-223035520e0e-host\") pod \"node-ca-gx4hg\" (UID: \"1a4e159e-96e1-4c0c-a18c-223035520e0e\") " pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216772 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-system-cni-dir\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216787 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-var-lib-kubelet\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.217333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216801 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-conf-dir\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216818 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-lib-modules\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216837 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jttnl\" (UniqueName: \"kubernetes.io/projected/eba56436-f6d7-4268-a036-476e9da0943e-kube-api-access-jttnl\") pod \"node-resolver-pjllx\" (UID: \"eba56436-f6d7-4268-a036-476e9da0943e\") " pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216871 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6n79\" (UniqueName: \"kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79\") pod \"network-check-target-jf4ln\" (UID: \"a61eba4f-358c-44d0-84f4-27c49d9eb58c\") " pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216894 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-socket-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216910 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a4e159e-96e1-4c0c-a18c-223035520e0e-serviceca\") pod \"node-ca-gx4hg\" (UID: \"1a4e159e-96e1-4c0c-a18c-223035520e0e\") " pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216942 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnxx2\" (UniqueName: \"kubernetes.io/projected/a46359ec-0a2a-464a-9f12-9997480a91a3-kube-api-access-gnxx2\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216967 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbh6t\" (UniqueName: \"kubernetes.io/projected/1a4e159e-96e1-4c0c-a18c-223035520e0e-kube-api-access-jbh6t\") pod \"node-ca-gx4hg\" (UID: \"1a4e159e-96e1-4c0c-a18c-223035520e0e\") " pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.216986 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-slash\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.217039 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-run-netns\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.217063 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-sysconfig\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.217086 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-registration-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.217888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.217103 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62zps\" (UniqueName: \"kubernetes.io/projected/787a3934-5d38-4057-99a1-3332f7da451d-kube-api-access-62zps\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.318298 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318262 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-cnibin\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318304 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/787a3934-5d38-4057-99a1-3332f7da451d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318331 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-cnibin\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318353 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-kubelet\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318378 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-systemd\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318398 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-sys\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318401 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-cnibin\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318420 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e758f834-160a-40f4-a469-520979a5e4c7-dbus\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318413 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-kubelet\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318442 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-os-release\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318467 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-systemd\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318469 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-sys\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318481 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-run-k8s-cni-cncf-io\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318514 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/515b9eac-60b8-41e5-b125-1605a93e7612-etc-tuned\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318517 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-os-release\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.318529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318417 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-cnibin\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318539 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-var-lib-cni-multus\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318565 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-node-log\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318564 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-run-k8s-cni-cncf-io\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318591 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qshml\" (UniqueName: \"kubernetes.io/projected/515b9eac-60b8-41e5-b125-1605a93e7612-kube-api-access-qshml\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318618 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-var-lib-cni-multus\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318618 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-device-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318630 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e758f834-160a-40f4-a469-520979a5e4c7-dbus\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318657 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-node-log\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318657 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/787a3934-5d38-4057-99a1-3332f7da451d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318740 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-host\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318768 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eba56436-f6d7-4268-a036-476e9da0943e-hosts-file\") pod \"node-resolver-pjllx\" (UID: \"eba56436-f6d7-4268-a036-476e9da0943e\") " pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318805 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-device-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318814 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-cni-dir\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318843 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-run-netns\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318867 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-host\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318868 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-var-lib-openvswitch\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318871 2539 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 17:38:51.319390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318935 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-run-netns\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318947 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/787a3934-5d38-4057-99a1-3332f7da451d-cni-binary-copy\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318956 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-cni-dir\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.318983 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319020 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-var-lib-openvswitch\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319041 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a46359ec-0a2a-464a-9f12-9997480a91a3-ovn-node-metrics-cert\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319069 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-modprobe-d\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319080 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319090 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eba56436-f6d7-4268-a036-476e9da0943e-hosts-file\") pod \"node-resolver-pjllx\" (UID: \"eba56436-f6d7-4268-a036-476e9da0943e\") " pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319094 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-kubernetes\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319128 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57320a61-81a7-4f23-8a83-6f97dd7a07b2-iptables-alerter-script\") pod \"iptables-alerter-88p55\" (UID: \"57320a61-81a7-4f23-8a83-6f97dd7a07b2\") " pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319154 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-run-openvswitch\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319149 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-kubernetes\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319166 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/787a3934-5d38-4057-99a1-3332f7da451d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319181 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-cni-netd\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319188 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-modprobe-d\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319219 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a46359ec-0a2a-464a-9f12-9997480a91a3-ovnkube-script-lib\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.320435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319243 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-var-lib-kubelet\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319251 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-cni-netd\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319263 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57320a61-81a7-4f23-8a83-6f97dd7a07b2-host-slash\") pod \"iptables-alerter-88p55\" (UID: \"57320a61-81a7-4f23-8a83-6f97dd7a07b2\") " pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319290 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-socket-dir-parent\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319323 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57320a61-81a7-4f23-8a83-6f97dd7a07b2-host-slash\") pod \"iptables-alerter-88p55\" (UID: \"57320a61-81a7-4f23-8a83-6f97dd7a07b2\") " pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319351 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-daemon-config\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319385 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-var-lib-kubelet\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319387 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-run-systemd\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319425 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-run-systemd\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319426 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e758f834-160a-40f4-a469-520979a5e4c7-kubelet-config\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319463 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319466 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e758f834-160a-40f4-a469-520979a5e4c7-kubelet-config\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319222 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-run-openvswitch\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319490 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-etc-selinux\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319516 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319523 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-socket-dir-parent\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319540 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-etc-kubernetes\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.321320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319566 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a46359ec-0a2a-464a-9f12-9997480a91a3-env-overrides\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319590 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/515b9eac-60b8-41e5-b125-1605a93e7612-tmp\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319616 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-os-release\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319641 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-run-ovn\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319664 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eba56436-f6d7-4268-a036-476e9da0943e-tmp-dir\") pod \"node-resolver-pjllx\" (UID: \"eba56436-f6d7-4268-a036-476e9da0943e\") " pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319670 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319689 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319713 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdzb9\" (UniqueName: \"kubernetes.io/projected/a31b714e-0b4b-4193-baf1-4473afd54463-kube-api-access-rdzb9\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319737 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70aaad28-a30e-4bb0-8919-df1cbb7c0ea9-agent-certs\") pod \"konnectivity-agent-drkkl\" (UID: \"70aaad28-a30e-4bb0-8919-df1cbb7c0ea9\") " pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319741 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57320a61-81a7-4f23-8a83-6f97dd7a07b2-iptables-alerter-script\") pod \"iptables-alerter-88p55\" (UID: \"57320a61-81a7-4f23-8a83-6f97dd7a07b2\") " pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319749 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-etc-selinux\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319799 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-var-lib-cni-bin\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319829 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-hostroot\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319859 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-run-multus-certs\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319888 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-systemd-units\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319915 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-sysctl-conf\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319942 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdcvm\" (UniqueName: \"kubernetes.io/projected/57320a61-81a7-4f23-8a83-6f97dd7a07b2-kube-api-access-sdcvm\") pod \"iptables-alerter-88p55\" (UID: \"57320a61-81a7-4f23-8a83-6f97dd7a07b2\") " pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.322184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319951 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a46359ec-0a2a-464a-9f12-9997480a91a3-ovnkube-script-lib\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319970 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb8d8\" (UniqueName: \"kubernetes.io/projected/3f8fc970-c51f-449e-aa11-776bcca8d167-kube-api-access-zb8d8\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.319999 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dda9101d-ad36-4d77-8169-2d8b7524075b-cni-binary-copy\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320015 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-run-multus-certs\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320026 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-log-socket\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320053 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-cni-bin\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320054 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-var-lib-cni-bin\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320077 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-run\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320097 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-hostroot\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320104 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-sys-fs\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320141 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-system-cni-dir\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320168 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/787a3934-5d38-4057-99a1-3332f7da451d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320198 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-etc-openvswitch\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320223 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-sysctl-d\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320268 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-sysctl-conf\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320272 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320320 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a4e159e-96e1-4c0c-a18c-223035520e0e-host\") pod \"node-ca-gx4hg\" (UID: \"1a4e159e-96e1-4c0c-a18c-223035520e0e\") " pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320347 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-system-cni-dir\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.323079 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.320363 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320374 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-var-lib-kubelet\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320402 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-conf-dir\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.320443 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs podName:a31b714e-0b4b-4193-baf1-4473afd54463 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:51.820404867 +0000 UTC m=+2.051650049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs") pod "network-metrics-daemon-dpd7c" (UID: "a31b714e-0b4b-4193-baf1-4473afd54463") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320471 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-lib-modules\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320501 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jttnl\" (UniqueName: \"kubernetes.io/projected/eba56436-f6d7-4268-a036-476e9da0943e-kube-api-access-jttnl\") pod \"node-resolver-pjllx\" (UID: \"eba56436-f6d7-4268-a036-476e9da0943e\") " pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320531 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6n79\" (UniqueName: \"kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79\") pod \"network-check-target-jf4ln\" (UID: \"a61eba4f-358c-44d0-84f4-27c49d9eb58c\") " pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320584 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-socket-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320611 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a4e159e-96e1-4c0c-a18c-223035520e0e-serviceca\") pod \"node-ca-gx4hg\" (UID: \"1a4e159e-96e1-4c0c-a18c-223035520e0e\") " pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320619 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-conf-dir\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320643 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnxx2\" (UniqueName: \"kubernetes.io/projected/a46359ec-0a2a-464a-9f12-9997480a91a3-kube-api-access-gnxx2\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320671 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbh6t\" (UniqueName: \"kubernetes.io/projected/1a4e159e-96e1-4c0c-a18c-223035520e0e-kube-api-access-jbh6t\") pod \"node-ca-gx4hg\" (UID: \"1a4e159e-96e1-4c0c-a18c-223035520e0e\") " pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320702 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-slash\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320729 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-run-netns\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320756 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-sysconfig\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320826 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-registration-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.323858 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320889 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62zps\" (UniqueName: \"kubernetes.io/projected/787a3934-5d38-4057-99a1-3332f7da451d-kube-api-access-62zps\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320914 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1a4e159e-96e1-4c0c-a18c-223035520e0e-host\") pod \"node-ca-gx4hg\" (UID: \"1a4e159e-96e1-4c0c-a18c-223035520e0e\") " pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320919 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70aaad28-a30e-4bb0-8919-df1cbb7c0ea9-konnectivity-ca\") pod \"konnectivity-agent-drkkl\" (UID: \"70aaad28-a30e-4bb0-8919-df1cbb7c0ea9\") " pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320967 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x59x8\" (UniqueName: \"kubernetes.io/projected/dda9101d-ad36-4d77-8169-2d8b7524075b-kube-api-access-x59x8\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320995 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320996 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a46359ec-0a2a-464a-9f12-9997480a91a3-env-overrides\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.321052 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a46359ec-0a2a-464a-9f12-9997480a91a3-ovnkube-config\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.321482 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/70aaad28-a30e-4bb0-8919-df1cbb7c0ea9-konnectivity-ca\") pod \"konnectivity-agent-drkkl\" (UID: \"70aaad28-a30e-4bb0-8919-df1cbb7c0ea9\") " pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.321594 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a46359ec-0a2a-464a-9f12-9997480a91a3-ovnkube-config\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.321742 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.321972 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-socket-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.321981 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dda9101d-ad36-4d77-8169-2d8b7524075b-cni-binary-copy\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322015 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-system-cni-dir\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320376 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-etc-kubernetes\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322075 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-slash\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322080 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-log-socket\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322135 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-sysconfig\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322136 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-cni-bin\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.324640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322185 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-run\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322199 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-registration-dir\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322245 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f8fc970-c51f-449e-aa11-776bcca8d167-sys-fs\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320097 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dda9101d-ad36-4d77-8169-2d8b7524075b-multus-daemon-config\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322273 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-run-ovn-kubernetes\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.321596 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-lib-modules\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322497 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/787a3934-5d38-4057-99a1-3332f7da451d-system-cni-dir\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322733 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1a4e159e-96e1-4c0c-a18c-223035520e0e-serviceca\") pod \"node-ca-gx4hg\" (UID: \"1a4e159e-96e1-4c0c-a18c-223035520e0e\") " pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.322834 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-os-release\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.323070 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/787a3934-5d38-4057-99a1-3332f7da451d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.323091 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dda9101d-ad36-4d77-8169-2d8b7524075b-host-var-lib-kubelet\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.320170 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-systemd-units\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.323118 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eba56436-f6d7-4268-a036-476e9da0943e-tmp-dir\") pod \"node-resolver-pjllx\" (UID: \"eba56436-f6d7-4268-a036-476e9da0943e\") " pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.323139 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-etc-openvswitch\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.323182 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-host-run-netns\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.323208 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a46359ec-0a2a-464a-9f12-9997480a91a3-run-ovn\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.323222 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/515b9eac-60b8-41e5-b125-1605a93e7612-etc-sysctl-d\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.325292 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.323271 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:38:51.325920 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.323333 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret podName:e758f834-160a-40f4-a469-520979a5e4c7 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:51.82331499 +0000 UTC m=+2.054560173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret") pod "global-pull-secret-syncer-kd4d2" (UID: "e758f834-160a-40f4-a469-520979a5e4c7") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:38:51.325920 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.323361 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/515b9eac-60b8-41e5-b125-1605a93e7612-etc-tuned\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.325920 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.323606 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/515b9eac-60b8-41e5-b125-1605a93e7612-tmp\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.325920 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.323628 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/70aaad28-a30e-4bb0-8919-df1cbb7c0ea9-agent-certs\") pod \"konnectivity-agent-drkkl\" (UID: \"70aaad28-a30e-4bb0-8919-df1cbb7c0ea9\") " pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:38:51.325920 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.325429 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a46359ec-0a2a-464a-9f12-9997480a91a3-ovn-node-metrics-cert\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.328016 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.327995 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qshml\" (UniqueName: \"kubernetes.io/projected/515b9eac-60b8-41e5-b125-1605a93e7612-kube-api-access-qshml\") pod \"tuned-6hkjj\" (UID: \"515b9eac-60b8-41e5-b125-1605a93e7612\") " pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.330589 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.330564 2539 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:38:51.331860 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.331834 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdcvm\" (UniqueName: \"kubernetes.io/projected/57320a61-81a7-4f23-8a83-6f97dd7a07b2-kube-api-access-sdcvm\") pod \"iptables-alerter-88p55\" (UID: \"57320a61-81a7-4f23-8a83-6f97dd7a07b2\") " pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.332178 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.332090 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:38:51.332178 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.332171 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:38:51.332548 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.332185 2539 projected.go:196] Error preparing data for projected volume kube-api-access-p6n79 for pod openshift-network-diagnostics/network-check-target-jf4ln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:38:51.332548 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.332347 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79 podName:a61eba4f-358c-44d0-84f4-27c49d9eb58c nodeName:}" failed. No retries permitted until 2026-07-06 17:38:51.832325833 +0000 UTC m=+2.063571010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p6n79" (UniqueName: "kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79") pod "network-check-target-jf4ln" (UID: "a61eba4f-358c-44d0-84f4-27c49d9eb58c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:38:51.334582 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.334560 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x59x8\" (UniqueName: \"kubernetes.io/projected/dda9101d-ad36-4d77-8169-2d8b7524075b-kube-api-access-x59x8\") pod \"multus-jqmtq\" (UID: \"dda9101d-ad36-4d77-8169-2d8b7524075b\") " pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.335190 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.335149 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnxx2\" (UniqueName: \"kubernetes.io/projected/a46359ec-0a2a-464a-9f12-9997480a91a3-kube-api-access-gnxx2\") pod \"ovnkube-node-rcbtm\" (UID: \"a46359ec-0a2a-464a-9f12-9997480a91a3\") " pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.335284 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.335195 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jttnl\" (UniqueName: \"kubernetes.io/projected/eba56436-f6d7-4268-a036-476e9da0943e-kube-api-access-jttnl\") pod \"node-resolver-pjllx\" (UID: \"eba56436-f6d7-4268-a036-476e9da0943e\") " pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.335284 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.335236 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbh6t\" (UniqueName: \"kubernetes.io/projected/1a4e159e-96e1-4c0c-a18c-223035520e0e-kube-api-access-jbh6t\") pod \"node-ca-gx4hg\" (UID: \"1a4e159e-96e1-4c0c-a18c-223035520e0e\") " pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.335284 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.335255 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb8d8\" (UniqueName: \"kubernetes.io/projected/3f8fc970-c51f-449e-aa11-776bcca8d167-kube-api-access-zb8d8\") pod \"aws-ebs-csi-driver-node-2wtb7\" (UID: \"3f8fc970-c51f-449e-aa11-776bcca8d167\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.335284 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.335255 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdzb9\" (UniqueName: \"kubernetes.io/projected/a31b714e-0b4b-4193-baf1-4473afd54463-kube-api-access-rdzb9\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:51.335730 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.335695 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62zps\" (UniqueName: \"kubernetes.io/projected/787a3934-5d38-4057-99a1-3332f7da451d-kube-api-access-62zps\") pod \"multus-additional-cni-plugins-xq8hn\" (UID: \"787a3934-5d38-4057-99a1-3332f7da451d\") " pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.340032 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.339997 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod096de2595b7c83568a62cfe98f27c518.slice/crio-ab2cb7a2fcde0c5e38622d61f8cfc78ff92e41f887518a0ebc3f58ae645ff881 WatchSource:0}: Error finding container ab2cb7a2fcde0c5e38622d61f8cfc78ff92e41f887518a0ebc3f58ae645ff881: Status 404 returned error can't find the container with id ab2cb7a2fcde0c5e38622d61f8cfc78ff92e41f887518a0ebc3f58ae645ff881 Jul 06 17:38:51.342287 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.342262 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7813548906f23d840a9a9ca553f805.slice/crio-53a49019f80f064aa20a20ac26ba1435c694022008d677b38af90e98fa3d0bb1 WatchSource:0}: Error finding container 53a49019f80f064aa20a20ac26ba1435c694022008d677b38af90e98fa3d0bb1: Status 404 returned error can't find the container with id 53a49019f80f064aa20a20ac26ba1435c694022008d677b38af90e98fa3d0bb1 Jul 06 17:38:51.346231 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.346215 2539 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:38:51.434379 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.434287 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jqmtq" Jul 06 17:38:51.444716 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.444681 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda9101d_ad36_4d77_8169_2d8b7524075b.slice/crio-4b466b141564ea92634801c60c851d44e79c8756389a227bcb0c774e607319c1 WatchSource:0}: Error finding container 4b466b141564ea92634801c60c851d44e79c8756389a227bcb0c774e607319c1: Status 404 returned error can't find the container with id 4b466b141564ea92634801c60c851d44e79c8756389a227bcb0c774e607319c1 Jul 06 17:38:51.456296 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.456274 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:38:51.467901 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.467877 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46359ec_0a2a_464a_9f12_9997480a91a3.slice/crio-b00e5cb2af5928234e6176a26612904f31e9df2d36e43515837a89c573958fa0 WatchSource:0}: Error finding container b00e5cb2af5928234e6176a26612904f31e9df2d36e43515837a89c573958fa0: Status 404 returned error can't find the container with id b00e5cb2af5928234e6176a26612904f31e9df2d36e43515837a89c573958fa0 Jul 06 17:38:51.471430 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.471407 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" Jul 06 17:38:51.479936 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.479914 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f8fc970_c51f_449e_aa11_776bcca8d167.slice/crio-14f3306919d6905dfdc20a03ec0e65be61d62d3684053fb94c8ed4525c619723 WatchSource:0}: Error finding container 14f3306919d6905dfdc20a03ec0e65be61d62d3684053fb94c8ed4525c619723: Status 404 returned error can't find the container with id 14f3306919d6905dfdc20a03ec0e65be61d62d3684053fb94c8ed4525c619723 Jul 06 17:38:51.488050 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.488018 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" Jul 06 17:38:51.498920 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.498893 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515b9eac_60b8_41e5_b125_1605a93e7612.slice/crio-8a8c9800839c4eeaee865f5d2cdde554d7fcfb861ce9f3648d3e3f3aae547e48 WatchSource:0}: Error finding container 8a8c9800839c4eeaee865f5d2cdde554d7fcfb861ce9f3648d3e3f3aae547e48: Status 404 returned error can't find the container with id 8a8c9800839c4eeaee865f5d2cdde554d7fcfb861ce9f3648d3e3f3aae547e48 Jul 06 17:38:51.506759 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.506740 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pjllx" Jul 06 17:38:51.516185 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.516161 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba56436_f6d7_4268_a036_476e9da0943e.slice/crio-22b9597e3ec620a42bc05bed0035a00b83bec5f872603112d6e311cf2225dc52 WatchSource:0}: Error finding container 22b9597e3ec620a42bc05bed0035a00b83bec5f872603112d6e311cf2225dc52: Status 404 returned error can't find the container with id 22b9597e3ec620a42bc05bed0035a00b83bec5f872603112d6e311cf2225dc52 Jul 06 17:38:51.522934 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.522915 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gx4hg" Jul 06 17:38:51.531534 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.531502 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4e159e_96e1_4c0c_a18c_223035520e0e.slice/crio-4ffc26ebe3714989299cda0e649566595db39974a9a785a070bb060bafa0f5b1 WatchSource:0}: Error finding container 4ffc26ebe3714989299cda0e649566595db39974a9a785a070bb060bafa0f5b1: Status 404 returned error can't find the container with id 4ffc26ebe3714989299cda0e649566595db39974a9a785a070bb060bafa0f5b1 Jul 06 17:38:51.535875 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.535857 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" Jul 06 17:38:51.544721 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.544696 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787a3934_5d38_4057_99a1_3332f7da451d.slice/crio-a9924ad9798a5324b8cdaabd6f21c28e6c319018652ff07b3875008616b57d24 WatchSource:0}: Error finding container a9924ad9798a5324b8cdaabd6f21c28e6c319018652ff07b3875008616b57d24: Status 404 returned error can't find the container with id a9924ad9798a5324b8cdaabd6f21c28e6c319018652ff07b3875008616b57d24 Jul 06 17:38:51.563029 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.563007 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88p55" Jul 06 17:38:51.568071 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.568054 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:38:51.573005 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.572983 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57320a61_81a7_4f23_8a83_6f97dd7a07b2.slice/crio-193a0136e0540d52f11010c675c76908fbf4b1cf5bd5b9182b1d6a1bedf892d9 WatchSource:0}: Error finding container 193a0136e0540d52f11010c675c76908fbf4b1cf5bd5b9182b1d6a1bedf892d9: Status 404 returned error can't find the container with id 193a0136e0540d52f11010c675c76908fbf4b1cf5bd5b9182b1d6a1bedf892d9 Jul 06 17:38:51.577544 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:38:51.577522 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70aaad28_a30e_4bb0_8919_df1cbb7c0ea9.slice/crio-ef7453df17b51e3f5b493467202d1f853caea7979718d552bd8c68b4d7dd6827 WatchSource:0}: Error finding container ef7453df17b51e3f5b493467202d1f853caea7979718d552bd8c68b4d7dd6827: Status 404 returned error can't find the container with id ef7453df17b51e3f5b493467202d1f853caea7979718d552bd8c68b4d7dd6827 Jul 06 17:38:51.825227 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.825136 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:51.825227 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.825186 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:51.825408 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.825303 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:38:51.825408 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.825307 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:38:51.825408 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.825365 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs podName:a31b714e-0b4b-4193-baf1-4473afd54463 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:52.825346313 +0000 UTC m=+3.056591481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs") pod "network-metrics-daemon-dpd7c" (UID: "a31b714e-0b4b-4193-baf1-4473afd54463") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:38:51.825408 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.825379 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret podName:e758f834-160a-40f4-a469-520979a5e4c7 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:52.825373128 +0000 UTC m=+3.056618283 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret") pod "global-pull-secret-syncer-kd4d2" (UID: "e758f834-160a-40f4-a469-520979a5e4c7") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:38:51.926564 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:51.926526 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6n79\" (UniqueName: \"kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79\") pod \"network-check-target-jf4ln\" (UID: \"a61eba4f-358c-44d0-84f4-27c49d9eb58c\") " pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:51.926754 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.926738 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:38:51.926852 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.926764 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:38:51.926852 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.926778 2539 projected.go:196] Error preparing data for projected volume kube-api-access-p6n79 for pod openshift-network-diagnostics/network-check-target-jf4ln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:38:51.926852 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:51.926837 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79 podName:a61eba4f-358c-44d0-84f4-27c49d9eb58c nodeName:}" failed. No retries permitted until 2026-07-06 17:38:52.926818409 +0000 UTC m=+3.158063588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6n79" (UniqueName: "kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79") pod "network-check-target-jf4ln" (UID: "a61eba4f-358c-44d0-84f4-27c49d9eb58c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:38:52.156088 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.155953 2539 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 17:33:51 +0000 UTC" deadline="2028-02-09 06:08:26.20547418 +0000 UTC" Jul 06 17:38:52.156088 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.156023 2539 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13980h29m34.04945533s" Jul 06 17:38:52.344516 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.344450 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drkkl" event={"ID":"70aaad28-a30e-4bb0-8919-df1cbb7c0ea9","Type":"ContainerStarted","Data":"ef7453df17b51e3f5b493467202d1f853caea7979718d552bd8c68b4d7dd6827"} Jul 06 17:38:52.364100 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.364063 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88p55" event={"ID":"57320a61-81a7-4f23-8a83-6f97dd7a07b2","Type":"ContainerStarted","Data":"193a0136e0540d52f11010c675c76908fbf4b1cf5bd5b9182b1d6a1bedf892d9"} Jul 06 17:38:52.371623 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.371573 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gx4hg" event={"ID":"1a4e159e-96e1-4c0c-a18c-223035520e0e","Type":"ContainerStarted","Data":"4ffc26ebe3714989299cda0e649566595db39974a9a785a070bb060bafa0f5b1"} Jul 06 17:38:52.382576 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.382533 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pjllx" event={"ID":"eba56436-f6d7-4268-a036-476e9da0943e","Type":"ContainerStarted","Data":"22b9597e3ec620a42bc05bed0035a00b83bec5f872603112d6e311cf2225dc52"} Jul 06 17:38:52.391938 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.391854 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" event={"ID":"515b9eac-60b8-41e5-b125-1605a93e7612","Type":"ContainerStarted","Data":"8a8c9800839c4eeaee865f5d2cdde554d7fcfb861ce9f3648d3e3f3aae547e48"} Jul 06 17:38:52.395709 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.395651 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" event={"ID":"3f8fc970-c51f-449e-aa11-776bcca8d167","Type":"ContainerStarted","Data":"14f3306919d6905dfdc20a03ec0e65be61d62d3684053fb94c8ed4525c619723"} Jul 06 17:38:52.412612 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.408962 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" event={"ID":"096de2595b7c83568a62cfe98f27c518","Type":"ContainerStarted","Data":"ab2cb7a2fcde0c5e38622d61f8cfc78ff92e41f887518a0ebc3f58ae645ff881"} Jul 06 17:38:52.412612 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.410931 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" event={"ID":"787a3934-5d38-4057-99a1-3332f7da451d","Type":"ContainerStarted","Data":"a9924ad9798a5324b8cdaabd6f21c28e6c319018652ff07b3875008616b57d24"} Jul 06 17:38:52.417703 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.417649 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" event={"ID":"a46359ec-0a2a-464a-9f12-9997480a91a3","Type":"ContainerStarted","Data":"b00e5cb2af5928234e6176a26612904f31e9df2d36e43515837a89c573958fa0"} Jul 06 17:38:52.441726 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.441664 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jqmtq" event={"ID":"dda9101d-ad36-4d77-8169-2d8b7524075b","Type":"ContainerStarted","Data":"4b466b141564ea92634801c60c851d44e79c8756389a227bcb0c774e607319c1"} Jul 06 17:38:52.453432 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.453323 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" event={"ID":"5b7813548906f23d840a9a9ca553f805","Type":"ContainerStarted","Data":"53a49019f80f064aa20a20ac26ba1435c694022008d677b38af90e98fa3d0bb1"} Jul 06 17:38:52.585492 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.585397 2539 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:38:52.636149 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.636111 2539 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:38:52.834605 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.834507 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:52.834605 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.834580 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:52.834899 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:52.834798 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:38:52.834899 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:52.834869 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs podName:a31b714e-0b4b-4193-baf1-4473afd54463 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:54.834848573 +0000 UTC m=+5.066093750 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs") pod "network-metrics-daemon-dpd7c" (UID: "a31b714e-0b4b-4193-baf1-4473afd54463") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:38:52.835320 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:52.835295 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:38:52.835428 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:52.835356 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret podName:e758f834-160a-40f4-a469-520979a5e4c7 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:54.835340335 +0000 UTC m=+5.066585516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret") pod "global-pull-secret-syncer-kd4d2" (UID: "e758f834-160a-40f4-a469-520979a5e4c7") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:38:52.935482 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:52.935215 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6n79\" (UniqueName: \"kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79\") pod \"network-check-target-jf4ln\" (UID: \"a61eba4f-358c-44d0-84f4-27c49d9eb58c\") " pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:52.935685 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:52.935443 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:38:52.935685 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:52.935544 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:38:52.935685 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:52.935564 2539 projected.go:196] Error preparing data for projected volume kube-api-access-p6n79 for pod openshift-network-diagnostics/network-check-target-jf4ln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:38:52.935685 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:52.935635 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79 podName:a61eba4f-358c-44d0-84f4-27c49d9eb58c nodeName:}" failed. No retries permitted until 2026-07-06 17:38:54.935615902 +0000 UTC m=+5.166861061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6n79" (UniqueName: "kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79") pod "network-check-target-jf4ln" (UID: "a61eba4f-358c-44d0-84f4-27c49d9eb58c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:38:53.157343 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:53.157237 2539 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 17:33:51 +0000 UTC" deadline="2028-04-10 16:25:34.787777948 +0000 UTC" Jul 06 17:38:53.157343 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:53.157280 2539 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15454h46m41.630502969s" Jul 06 17:38:53.299146 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:53.299046 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:53.299146 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:53.299096 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:53.299383 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:53.299209 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:53.299383 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:53.299207 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:38:53.299383 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:53.299362 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:38:53.299562 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:53.299457 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:38:54.216149 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:54.216114 2539 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 17:38:54.852769 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:54.852697 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:54.852970 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:54.852781 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:54.852970 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:54.852939 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:38:54.853079 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:54.853005 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs podName:a31b714e-0b4b-4193-baf1-4473afd54463 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:58.852984706 +0000 UTC m=+9.084229865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs") pod "network-metrics-daemon-dpd7c" (UID: "a31b714e-0b4b-4193-baf1-4473afd54463") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:38:54.853457 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:54.853438 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:38:54.853541 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:54.853493 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret podName:e758f834-160a-40f4-a469-520979a5e4c7 nodeName:}" failed. No retries permitted until 2026-07-06 17:38:58.853476808 +0000 UTC m=+9.084721964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret") pod "global-pull-secret-syncer-kd4d2" (UID: "e758f834-160a-40f4-a469-520979a5e4c7") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:38:54.953642 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:54.953598 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6n79\" (UniqueName: \"kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79\") pod \"network-check-target-jf4ln\" (UID: \"a61eba4f-358c-44d0-84f4-27c49d9eb58c\") " pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:54.953962 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:54.953821 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:38:54.953962 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:54.953842 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:38:54.953962 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:54.953856 2539 projected.go:196] Error preparing data for projected volume kube-api-access-p6n79 for pod openshift-network-diagnostics/network-check-target-jf4ln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:38:54.953962 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:54.953921 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79 podName:a61eba4f-358c-44d0-84f4-27c49d9eb58c nodeName:}" failed. No retries permitted until 2026-07-06 17:38:58.953898771 +0000 UTC m=+9.185143932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6n79" (UniqueName: "kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79") pod "network-check-target-jf4ln" (UID: "a61eba4f-358c-44d0-84f4-27c49d9eb58c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:38:55.299344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:55.298404 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:55.299344 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:55.298548 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:38:55.299344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:55.299026 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:55.299344 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:55.299129 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:38:55.299344 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:55.299160 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:55.299344 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:55.299239 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:38:57.299086 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:57.299024 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:57.299086 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:57.299065 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:57.299086 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:57.299065 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:57.299655 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:57.299156 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:38:57.299655 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:57.299231 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:38:57.299655 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:57.299318 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:38:58.892380 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:58.892244 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:58.892380 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:58.892309 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:58.892890 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:58.892425 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:38:58.892890 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:58.892467 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:38:58.892890 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:58.892523 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret podName:e758f834-160a-40f4-a469-520979a5e4c7 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:06.892502032 +0000 UTC m=+17.123747191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret") pod "global-pull-secret-syncer-kd4d2" (UID: "e758f834-160a-40f4-a469-520979a5e4c7") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:38:58.892890 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:58.892542 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs podName:a31b714e-0b4b-4193-baf1-4473afd54463 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:06.892533224 +0000 UTC m=+17.123778382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs") pod "network-metrics-daemon-dpd7c" (UID: "a31b714e-0b4b-4193-baf1-4473afd54463") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:38:58.992664 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:58.992625 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6n79\" (UniqueName: \"kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79\") pod \"network-check-target-jf4ln\" (UID: \"a61eba4f-358c-44d0-84f4-27c49d9eb58c\") " pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:58.992904 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:58.992882 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:38:58.992965 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:58.992910 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:38:58.992965 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:58.992924 2539 projected.go:196] Error preparing data for projected volume kube-api-access-p6n79 for pod openshift-network-diagnostics/network-check-target-jf4ln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:38:58.993049 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:58.992980 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79 podName:a61eba4f-358c-44d0-84f4-27c49d9eb58c nodeName:}" failed. No retries permitted until 2026-07-06 17:39:06.992966821 +0000 UTC m=+17.224211974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6n79" (UniqueName: "kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79") pod "network-check-target-jf4ln" (UID: "a61eba4f-358c-44d0-84f4-27c49d9eb58c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:38:59.298442 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:59.298364 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:38:59.298442 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:59.298410 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:38:59.298651 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:59.298518 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:38:59.298651 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:59.298558 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:38:59.298651 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:38:59.298602 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:38:59.298806 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:38:59.298672 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:01.298521 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:01.298484 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:01.298983 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:01.298615 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:01.298983 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:01.298794 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:01.298983 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:01.298819 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:01.298983 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:01.298891 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:01.298983 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:01.298970 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:03.298345 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:03.298309 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:03.298784 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:03.298411 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:03.298784 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:03.298426 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:03.298784 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:03.298414 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:03.298784 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:03.298528 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:03.298784 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:03.298635 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:05.298308 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:05.298263 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:05.298308 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:05.298300 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:05.298809 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:05.298300 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:05.298809 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:05.298403 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:05.298809 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:05.298498 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:05.298809 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:05.298551 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:06.956516 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:06.956483 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:06.957062 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:06.956539 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:06.957062 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:06.956654 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:39:06.957062 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:06.956689 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:39:06.957062 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:06.956750 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret podName:e758f834-160a-40f4-a469-520979a5e4c7 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:22.956727598 +0000 UTC m=+33.187972760 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret") pod "global-pull-secret-syncer-kd4d2" (UID: "e758f834-160a-40f4-a469-520979a5e4c7") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:39:06.957062 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:06.956772 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs podName:a31b714e-0b4b-4193-baf1-4473afd54463 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:22.956761417 +0000 UTC m=+33.188006574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs") pod "network-metrics-daemon-dpd7c" (UID: "a31b714e-0b4b-4193-baf1-4473afd54463") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:39:07.057637 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:07.057592 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6n79\" (UniqueName: \"kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79\") pod \"network-check-target-jf4ln\" (UID: \"a61eba4f-358c-44d0-84f4-27c49d9eb58c\") " pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:07.057845 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:07.057821 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:39:07.057919 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:07.057852 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:39:07.057919 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:07.057864 2539 projected.go:196] Error preparing data for projected volume kube-api-access-p6n79 for pod openshift-network-diagnostics/network-check-target-jf4ln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:39:07.058049 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:07.057924 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79 podName:a61eba4f-358c-44d0-84f4-27c49d9eb58c nodeName:}" failed. No retries permitted until 2026-07-06 17:39:23.057906129 +0000 UTC m=+33.289151282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6n79" (UniqueName: "kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79") pod "network-check-target-jf4ln" (UID: "a61eba4f-358c-44d0-84f4-27c49d9eb58c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:39:07.298949 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:07.298870 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:07.299144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:07.298870 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:07.299144 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:07.298991 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:07.299144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:07.298881 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:07.299144 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:07.299074 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:07.299289 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:07.299146 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:09.298985 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:09.298951 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:09.299480 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:09.299002 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:09.299480 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:09.299057 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:09.299480 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:09.299070 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:09.299480 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:09.299165 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:09.299480 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:09.299253 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:11.298711 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:11.298658 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:11.299174 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:11.298789 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:11.299174 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:11.298804 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:11.299174 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:11.298885 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:11.299174 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:11.298879 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:11.299174 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:11.298960 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:12.508997 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:12.508966 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" event={"ID":"515b9eac-60b8-41e5-b125-1605a93e7612","Type":"ContainerStarted","Data":"1d55694dca78ef23534e606ac1bec01faa9cba15907f67e42b14cb898ab7cc6b"} Jul 06 17:39:12.510547 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:12.510524 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" event={"ID":"a46359ec-0a2a-464a-9f12-9997480a91a3","Type":"ContainerStarted","Data":"18a2c4fbf4cbb315d86b6c994d5409f55e294e3c9f9dca2d299ea4ea4b752f3d"} Jul 06 17:39:12.512073 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:12.511954 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jqmtq" event={"ID":"dda9101d-ad36-4d77-8169-2d8b7524075b","Type":"ContainerStarted","Data":"69f073b240aa709fc97bee52b46ebbaea49adc49951a0172f29a3c15ce3ec0e5"} Jul 06 17:39:12.513360 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:12.513342 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" event={"ID":"5b7813548906f23d840a9a9ca553f805","Type":"ContainerStarted","Data":"0685a31e733505f3fede7275ff17024c9385fae75db97f862c639e22094c8ded"} Jul 06 17:39:12.525002 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:12.524881 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6hkjj" podStartSLOduration=1.975618972 podStartE2EDuration="22.524868939s" totalImagesPullingTime="20.549249967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:12.524479514 +0000 UTC m=+22.755724689" watchObservedRunningTime="2026-07-06 17:39:12.524868939 +0000 UTC m=+22.756114115" Jul 06 17:39:12.537597 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:12.537544 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-203.ec2.internal" podStartSLOduration=21.537525537 podStartE2EDuration="21.537525537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:12.536899859 +0000 UTC m=+22.768145034" watchObservedRunningTime="2026-07-06 17:39:12.537525537 +0000 UTC m=+22.768770713" Jul 06 17:39:12.553277 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:12.553232 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jqmtq" podStartSLOduration=1.6856854289999998 podStartE2EDuration="22.553219566s" totalImagesPullingTime="20.867534137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:12.55291019 +0000 UTC m=+22.784155366" watchObservedRunningTime="2026-07-06 17:39:12.553219566 +0000 UTC m=+22.784464759" Jul 06 17:39:13.298959 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:13.298747 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:13.299086 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:13.298747 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:13.299086 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:13.299002 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:13.299086 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:13.298779 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:13.299182 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:13.299066 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:13.299182 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:13.299161 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:13.519163 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:13.519136 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:39:13.519830 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:13.519599 2539 generic.go:356] "Generic (PLEG): container finished" podID="a46359ec-0a2a-464a-9f12-9997480a91a3" containerID="13f1ac0e9fd96ab06f1b8d3298c42c943dc7138b0ffe15d86a900ca27a74463f" exitCode=1 Jul 06 17:39:13.519830 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:13.519727 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" event={"ID":"a46359ec-0a2a-464a-9f12-9997480a91a3","Type":"ContainerStarted","Data":"b3644b44d4c4bdec71ff18e85f10b8dcb721b0ee8329bdfc8ff6919bb48825f6"} Jul 06 17:39:13.519830 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:13.519826 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" event={"ID":"a46359ec-0a2a-464a-9f12-9997480a91a3","Type":"ContainerStarted","Data":"29b41682d712fa8fe9279a3ff59476d00af885cb3889fea8accb7285ff56ad82"} Jul 06 17:39:13.520004 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:13.519858 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" event={"ID":"a46359ec-0a2a-464a-9f12-9997480a91a3","Type":"ContainerStarted","Data":"d224ad6e00d8fbcb93d197b1f3750e34acfb949fa3b2ea406093c292cb7dbcc6"} Jul 06 17:39:13.520004 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:13.519897 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" event={"ID":"a46359ec-0a2a-464a-9f12-9997480a91a3","Type":"ContainerStarted","Data":"7e0a16609b4c8fcaef8c476a43441d079ecfa821348e6b9250541340341e12fd"} Jul 06 17:39:13.520004 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:13.519947 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" event={"ID":"a46359ec-0a2a-464a-9f12-9997480a91a3","Type":"ContainerDied","Data":"13f1ac0e9fd96ab06f1b8d3298c42c943dc7138b0ffe15d86a900ca27a74463f"} Jul 06 17:39:14.523747 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.523711 2539 generic.go:356] "Generic (PLEG): container finished" podID="096de2595b7c83568a62cfe98f27c518" containerID="47d609d2be648f09e1b3e5885e114d03c9f5cd80389af15db82b2e26bebe804a" exitCode=0 Jul 06 17:39:14.524318 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.523797 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" event={"ID":"096de2595b7c83568a62cfe98f27c518","Type":"ContainerDied","Data":"47d609d2be648f09e1b3e5885e114d03c9f5cd80389af15db82b2e26bebe804a"} Jul 06 17:39:14.525330 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.525307 2539 generic.go:356] "Generic (PLEG): container finished" podID="787a3934-5d38-4057-99a1-3332f7da451d" containerID="25d9603af434b407bb9b73efa0141bdc37ce33b099343949f9a9bb21ccba73bd" exitCode=0 Jul 06 17:39:14.525423 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.525380 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" event={"ID":"787a3934-5d38-4057-99a1-3332f7da451d","Type":"ContainerDied","Data":"25d9603af434b407bb9b73efa0141bdc37ce33b099343949f9a9bb21ccba73bd"} Jul 06 17:39:14.526656 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.526638 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drkkl" event={"ID":"70aaad28-a30e-4bb0-8919-df1cbb7c0ea9","Type":"ContainerStarted","Data":"583976862c106b6248a1c4e54bed4d6c780b82edbd3271ba531bfc42b53937dc"} Jul 06 17:39:14.527966 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.527948 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88p55" event={"ID":"57320a61-81a7-4f23-8a83-6f97dd7a07b2","Type":"ContainerStarted","Data":"790eb023ada519062a0c24089475bec136ed01df2b01a5735bc3880ae9a9fe7d"} Jul 06 17:39:14.529241 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.529216 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gx4hg" event={"ID":"1a4e159e-96e1-4c0c-a18c-223035520e0e","Type":"ContainerStarted","Data":"62cb1bfc7c255bed98776ff8f72de7e9fae5d84347ce2fa18e56805c53784dfe"} Jul 06 17:39:14.530427 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.530404 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pjllx" event={"ID":"eba56436-f6d7-4268-a036-476e9da0943e","Type":"ContainerStarted","Data":"b9c4ab2c7acc44ed43e3cf98da6e5bb5aa5966c09bb4b8ecba2eebb3230ddf4e"} Jul 06 17:39:14.531765 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.531748 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" event={"ID":"3f8fc970-c51f-449e-aa11-776bcca8d167","Type":"ContainerStarted","Data":"fd32a1d9aa83b2378efa4097e5087c205b520089505cdc581f7c9bbcd7191701"} Jul 06 17:39:14.573054 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.573000 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pjllx" podStartSLOduration=4.041413309 podStartE2EDuration="24.572985393s" totalImagesPullingTime="20.531572084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:14.572679872 +0000 UTC m=+24.803925049" watchObservedRunningTime="2026-07-06 17:39:14.572985393 +0000 UTC m=+24.804230569" Jul 06 17:39:14.585475 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.585433 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gx4hg" podStartSLOduration=4.068121437 podStartE2EDuration="24.58542051s" totalImagesPullingTime="20.517299073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:14.584968275 +0000 UTC m=+24.816213451" watchObservedRunningTime="2026-07-06 17:39:14.58542051 +0000 UTC m=+24.816665712" Jul 06 17:39:14.598730 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.598666 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-88p55" podStartSLOduration=4.11758591 podStartE2EDuration="24.598654247s" totalImagesPullingTime="20.481068337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:14.598194926 +0000 UTC m=+24.829440101" watchObservedRunningTime="2026-07-06 17:39:14.598654247 +0000 UTC m=+24.829899422" Jul 06 17:39:14.615730 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.615676 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-drkkl" podStartSLOduration=4.146119526 podStartE2EDuration="24.615660689s" totalImagesPullingTime="20.469541163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:14.615404537 +0000 UTC m=+24.846649713" watchObservedRunningTime="2026-07-06 17:39:14.615660689 +0000 UTC m=+24.846905862" Jul 06 17:39:14.696266 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.696239 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:39:14.697764 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.697622 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:39:14.739321 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.739253 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:14.750521 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.750500 2539 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 17:39:14.820982 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.820907 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:14.921011 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:14.920980 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:15.174768 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.174743 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:15.188366 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.188280 2539 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T17:39:14.750517774Z","UUID":"028f43c5-fefc-4dc0-88c7-3bbaa11170fa","Handler":null,"Name":"","Endpoint":""} Jul 06 17:39:15.189868 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.189851 2539 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 17:39:15.189946 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.189885 2539 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 17:39:15.277124 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.277088 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:15.299053 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.299020 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:15.299227 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.299181 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:15.299227 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.299203 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:15.299227 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:15.299206 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:15.299400 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:15.299277 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:15.299400 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:15.299360 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:15.536823 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.536728 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" event={"ID":"3f8fc970-c51f-449e-aa11-776bcca8d167","Type":"ContainerStarted","Data":"0b07b69b2594afdb68fd3a587072fad9d71a0e4e4abffa2619c8e14b4660907a"} Jul 06 17:39:15.541403 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.541373 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" event={"ID":"096de2595b7c83568a62cfe98f27c518","Type":"ContainerStarted","Data":"fbaaeb4a4dd29a3db62f29a10403548b7fc4f50200a7794beaa31ceb676883b3"} Jul 06 17:39:15.544810 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.544791 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:39:15.545294 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.545274 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" event={"ID":"a46359ec-0a2a-464a-9f12-9997480a91a3","Type":"ContainerStarted","Data":"274ab2c16ffbf2dd54f9ac6184f3f3f747698d14610c92e194035bdb32eb6cf5"} Jul 06 17:39:15.545458 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.545436 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:39:15.546093 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.546074 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-drkkl" Jul 06 17:39:15.557380 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.557330 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-203.ec2.internal" podStartSLOduration=24.557315227 podStartE2EDuration="24.557315227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:15.556768199 +0000 UTC m=+25.788013375" watchObservedRunningTime="2026-07-06 17:39:15.557315227 +0000 UTC m=+25.788560402" Jul 06 17:39:15.609104 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:15.609064 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:16.086289 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:16.086028 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:16.138475 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:16.138437 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:16.549633 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:16.549592 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" event={"ID":"3f8fc970-c51f-449e-aa11-776bcca8d167","Type":"ContainerStarted","Data":"700751a47bdc25c7a9e44f90c89f628cde40258569ef18d264fc127fb042a534"} Jul 06 17:39:17.298669 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:17.298634 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:17.298800 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:17.298782 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:17.298861 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:17.298791 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:17.298861 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:17.298814 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:17.298955 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:17.298911 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:17.299030 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:17.299012 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:17.556142 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:17.555861 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:39:17.556762 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:17.556585 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" event={"ID":"a46359ec-0a2a-464a-9f12-9997480a91a3","Type":"ContainerStarted","Data":"f84ab586c0ebd4d3e5c2c676398c9b2b77631c1b920af00b77dbc977c894881d"} Jul 06 17:39:17.557295 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:17.557280 2539 scope.go:117] "RemoveContainer" containerID="13f1ac0e9fd96ab06f1b8d3298c42c943dc7138b0ffe15d86a900ca27a74463f" Jul 06 17:39:17.583164 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:17.583111 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wtb7" podStartSLOduration=4.973028919 podStartE2EDuration="27.583089823s" totalImagesPullingTime="22.610060904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:16.570256304 +0000 UTC m=+26.801501490" watchObservedRunningTime="2026-07-06 17:39:17.583089823 +0000 UTC m=+27.814335002" Jul 06 17:39:18.465062 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:18.464994 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:18.563723 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:18.563439 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:39:18.564452 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:18.564425 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" event={"ID":"a46359ec-0a2a-464a-9f12-9997480a91a3","Type":"ContainerStarted","Data":"681ef82e94c0f5d301b8e950cdb15ac21271ce5f57eaeb461d6b8f57ef64c676"} Jul 06 17:39:18.564800 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:18.564785 2539 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 17:39:18.565762 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:18.565737 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:39:18.565887 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:18.565848 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:39:18.566334 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:18.566314 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:18.594924 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:18.592896 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:39:18.598254 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:18.598194 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" podStartSLOduration=7.998121612 podStartE2EDuration="28.598175251s" totalImagesPullingTime="20.600053639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:18.591517814 +0000 UTC m=+28.822763000" watchObservedRunningTime="2026-07-06 17:39:18.598175251 +0000 UTC m=+28.829420426" Jul 06 17:39:18.607733 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:18.607686 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:39:19.298840 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.298807 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:19.299015 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:19.298943 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:19.299346 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.299323 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:19.299464 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:19.299421 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:19.299519 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.299482 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:19.299576 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:19.299554 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:19.387307 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.387273 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jf4ln"] Jul 06 17:39:19.390355 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.390328 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dpd7c"] Jul 06 17:39:19.391187 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.391120 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kd4d2"] Jul 06 17:39:19.566354 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.566319 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:19.566354 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.566344 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:19.566871 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.566319 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:19.566871 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.566414 2539 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 17:39:19.566871 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:19.566451 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:19.566871 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:19.566551 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:19.567103 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:19.567084 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:19.681113 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:19.681084 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:39:20.570043 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:20.569777 2539 generic.go:356] "Generic (PLEG): container finished" podID="787a3934-5d38-4057-99a1-3332f7da451d" containerID="906a1ef21740c2199a75a531b039e53c67e3bad19814deb066c644c7cee98b03" exitCode=0 Jul 06 17:39:20.570043 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:20.569872 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" event={"ID":"787a3934-5d38-4057-99a1-3332f7da451d","Type":"ContainerDied","Data":"906a1ef21740c2199a75a531b039e53c67e3bad19814deb066c644c7cee98b03"} Jul 06 17:39:21.298315 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:21.298276 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:21.298492 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:21.298326 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:21.298492 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:21.298276 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:21.298492 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:21.298427 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:21.298643 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:21.298561 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:21.298714 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:21.298656 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:22.576604 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:22.576554 2539 generic.go:356] "Generic (PLEG): container finished" podID="787a3934-5d38-4057-99a1-3332f7da451d" containerID="9cbadb02966ccf2eff6f6f42adc10ccd7150ae05277108ba7c3bbda3c88ce6b1" exitCode=0 Jul 06 17:39:22.577171 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:22.576641 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" event={"ID":"787a3934-5d38-4057-99a1-3332f7da451d","Type":"ContainerDied","Data":"9cbadb02966ccf2eff6f6f42adc10ccd7150ae05277108ba7c3bbda3c88ce6b1"} Jul 06 17:39:22.973317 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:22.973284 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:22.973461 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:22.973325 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:22.973461 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:22.973429 2539 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 17:39:22.973461 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:22.973438 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:39:22.973564 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:22.973492 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret podName:e758f834-160a-40f4-a469-520979a5e4c7 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:54.973476567 +0000 UTC m=+65.204721736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret") pod "global-pull-secret-syncer-kd4d2" (UID: "e758f834-160a-40f4-a469-520979a5e4c7") : object "kube-system"/"original-pull-secret" not registered Jul 06 17:39:22.973564 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:22.973505 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs podName:a31b714e-0b4b-4193-baf1-4473afd54463 nodeName:}" failed. No retries permitted until 2026-07-06 17:39:54.973498929 +0000 UTC m=+65.204744082 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs") pod "network-metrics-daemon-dpd7c" (UID: "a31b714e-0b4b-4193-baf1-4473afd54463") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 17:39:23.074474 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:23.074441 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6n79\" (UniqueName: \"kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79\") pod \"network-check-target-jf4ln\" (UID: \"a61eba4f-358c-44d0-84f4-27c49d9eb58c\") " pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:23.074646 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:23.074624 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 17:39:23.074685 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:23.074650 2539 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 17:39:23.074685 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:23.074660 2539 projected.go:196] Error preparing data for projected volume kube-api-access-p6n79 for pod openshift-network-diagnostics/network-check-target-jf4ln: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:39:23.074767 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:23.074728 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79 podName:a61eba4f-358c-44d0-84f4-27c49d9eb58c nodeName:}" failed. No retries permitted until 2026-07-06 17:39:55.074714463 +0000 UTC m=+65.305959635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p6n79" (UniqueName: "kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79") pod "network-check-target-jf4ln" (UID: "a61eba4f-358c-44d0-84f4-27c49d9eb58c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 17:39:23.299014 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:23.298934 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:23.299149 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:23.298945 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:23.299149 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:23.299040 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:23.299149 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:23.299055 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:23.299149 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:23.299136 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:23.299310 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:23.299183 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:24.583429 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:24.583343 2539 generic.go:356] "Generic (PLEG): container finished" podID="787a3934-5d38-4057-99a1-3332f7da451d" containerID="b240d279ad4766d5999ac45a165320a464e8d8d61bf864408c621166adb561fa" exitCode=0 Jul 06 17:39:24.583429 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:24.583409 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" event={"ID":"787a3934-5d38-4057-99a1-3332f7da451d","Type":"ContainerDied","Data":"b240d279ad4766d5999ac45a165320a464e8d8d61bf864408c621166adb561fa"} Jul 06 17:39:25.298050 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:25.298014 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:25.298050 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:25.298038 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:25.298293 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:25.298045 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:25.298293 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:25.298135 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jf4ln" podUID="a61eba4f-358c-44d0-84f4-27c49d9eb58c" Jul 06 17:39:25.298293 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:25.298226 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kd4d2" podUID="e758f834-160a-40f4-a469-520979a5e4c7" Jul 06 17:39:25.298442 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:25.298294 2539 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpd7c" podUID="a31b714e-0b4b-4193-baf1-4473afd54463" Jul 06 17:39:26.581375 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.581344 2539 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-203.ec2.internal" event="NodeReady" Jul 06 17:39:26.581840 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.581513 2539 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 17:39:26.622375 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.622342 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qgt8l"] Jul 06 17:39:26.624393 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.624366 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.626781 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.626748 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 17:39:26.626781 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.626765 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-75j6z\"" Jul 06 17:39:26.626947 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.626820 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 17:39:26.629734 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.629711 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p6k57"] Jul 06 17:39:26.631889 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.631857 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p6k57" Jul 06 17:39:26.634838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.634184 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgt8l"] Jul 06 17:39:26.634838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.634540 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 17:39:26.634838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.634594 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-46kbs\"" Jul 06 17:39:26.634838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.634641 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 17:39:26.634838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.634756 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 17:39:26.642654 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.642633 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p6k57"] Jul 06 17:39:26.700465 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.700420 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.700624 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.700512 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5tqc\" (UniqueName: \"kubernetes.io/projected/3bbfc510-7647-447b-b42b-4b309310f1ee-kube-api-access-x5tqc\") pod \"ingress-canary-p6k57\" (UID: \"3bbfc510-7647-447b-b42b-4b309310f1ee\") " pod="openshift-ingress-canary/ingress-canary-p6k57" Jul 06 17:39:26.700624 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.700560 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bbfc510-7647-447b-b42b-4b309310f1ee-cert\") pod \"ingress-canary-p6k57\" (UID: \"3bbfc510-7647-447b-b42b-4b309310f1ee\") " pod="openshift-ingress-canary/ingress-canary-p6k57" Jul 06 17:39:26.700624 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.700599 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrhxj\" (UniqueName: \"kubernetes.io/projected/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-kube-api-access-nrhxj\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.700798 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.700625 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-config-volume\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.700798 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.700659 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-tmp-dir\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.743164 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.743079 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:26.801115 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.801075 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5tqc\" (UniqueName: \"kubernetes.io/projected/3bbfc510-7647-447b-b42b-4b309310f1ee-kube-api-access-x5tqc\") pod \"ingress-canary-p6k57\" (UID: \"3bbfc510-7647-447b-b42b-4b309310f1ee\") " pod="openshift-ingress-canary/ingress-canary-p6k57" Jul 06 17:39:26.801297 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.801142 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bbfc510-7647-447b-b42b-4b309310f1ee-cert\") pod \"ingress-canary-p6k57\" (UID: \"3bbfc510-7647-447b-b42b-4b309310f1ee\") " pod="openshift-ingress-canary/ingress-canary-p6k57" Jul 06 17:39:26.801297 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.801193 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrhxj\" (UniqueName: \"kubernetes.io/projected/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-kube-api-access-nrhxj\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.801297 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.801219 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-config-volume\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.801297 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.801259 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-tmp-dir\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.801626 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.801601 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.801678 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.801629 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-tmp-dir\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.801748 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:26.801738 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:39:26.801809 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:26.801797 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls podName:c0531ce9-1b32-4c03-b7b0-f84f6da395dd nodeName:}" failed. No retries permitted until 2026-07-06 17:39:27.301778866 +0000 UTC m=+37.533024044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls") pod "dns-default-qgt8l" (UID: "c0531ce9-1b32-4c03-b7b0-f84f6da395dd") : secret "dns-default-metrics-tls" not found Jul 06 17:39:26.802025 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.802007 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-config-volume\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.806635 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.806606 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bbfc510-7647-447b-b42b-4b309310f1ee-cert\") pod \"ingress-canary-p6k57\" (UID: \"3bbfc510-7647-447b-b42b-4b309310f1ee\") " pod="openshift-ingress-canary/ingress-canary-p6k57" Jul 06 17:39:26.811053 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.810897 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5tqc\" (UniqueName: \"kubernetes.io/projected/3bbfc510-7647-447b-b42b-4b309310f1ee-kube-api-access-x5tqc\") pod \"ingress-canary-p6k57\" (UID: \"3bbfc510-7647-447b-b42b-4b309310f1ee\") " pod="openshift-ingress-canary/ingress-canary-p6k57" Jul 06 17:39:26.811284 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.811260 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrhxj\" (UniqueName: \"kubernetes.io/projected/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-kube-api-access-nrhxj\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:26.944259 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:26.944219 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p6k57" Jul 06 17:39:27.100583 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.100529 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p6k57"] Jul 06 17:39:27.106347 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:39:27.106315 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbfc510_7647_447b_b42b_4b309310f1ee.slice/crio-b35684c54c2b81684a6a77c15ab3045c550810ef892d119718b94de190b9b3f1 WatchSource:0}: Error finding container b35684c54c2b81684a6a77c15ab3045c550810ef892d119718b94de190b9b3f1: Status 404 returned error can't find the container with id b35684c54c2b81684a6a77c15ab3045c550810ef892d119718b94de190b9b3f1 Jul 06 17:39:27.298663 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.298563 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:27.298663 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.298563 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:27.298894 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.298563 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:27.301410 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.301390 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 17:39:27.301529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.301462 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 17:39:27.301740 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.301725 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 17:39:27.301835 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.301730 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwzt2\"" Jul 06 17:39:27.301835 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.301766 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 17:39:27.301983 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.301966 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkf68\"" Jul 06 17:39:27.305164 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.305141 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:27.305294 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:27.305274 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:39:27.305354 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:27.305344 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls podName:c0531ce9-1b32-4c03-b7b0-f84f6da395dd nodeName:}" failed. No retries permitted until 2026-07-06 17:39:28.305328503 +0000 UTC m=+38.536573668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls") pod "dns-default-qgt8l" (UID: "c0531ce9-1b32-4c03-b7b0-f84f6da395dd") : secret "dns-default-metrics-tls" not found Jul 06 17:39:27.592046 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.591958 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p6k57" event={"ID":"3bbfc510-7647-447b-b42b-4b309310f1ee","Type":"ContainerStarted","Data":"b35684c54c2b81684a6a77c15ab3045c550810ef892d119718b94de190b9b3f1"} Jul 06 17:39:27.899786 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:27.899680 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:28.313780 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:28.313749 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:28.313952 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:28.313890 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:39:28.314003 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:28.313969 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls podName:c0531ce9-1b32-4c03-b7b0-f84f6da395dd nodeName:}" failed. No retries permitted until 2026-07-06 17:39:30.313946491 +0000 UTC m=+40.545191645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls") pod "dns-default-qgt8l" (UID: "c0531ce9-1b32-4c03-b7b0-f84f6da395dd") : secret "dns-default-metrics-tls" not found Jul 06 17:39:29.211496 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:29.211271 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:29.311592 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:29.311558 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:29.600837 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:29.600747 2539 generic.go:356] "Generic (PLEG): container finished" podID="787a3934-5d38-4057-99a1-3332f7da451d" containerID="edb2f74e6f8282ab4427f190b83c80f97781c3b13c48a8b473bd212c83af9f05" exitCode=0 Jul 06 17:39:29.600837 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:29.600810 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" event={"ID":"787a3934-5d38-4057-99a1-3332f7da451d","Type":"ContainerDied","Data":"edb2f74e6f8282ab4427f190b83c80f97781c3b13c48a8b473bd212c83af9f05"} Jul 06 17:39:29.805033 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:29.804996 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:29.866226 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:29.866138 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:30.332098 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:30.332063 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:30.332528 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:30.332197 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:39:30.332528 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:30.332265 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls podName:c0531ce9-1b32-4c03-b7b0-f84f6da395dd nodeName:}" failed. No retries permitted until 2026-07-06 17:39:34.332247229 +0000 UTC m=+44.563492386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls") pod "dns-default-qgt8l" (UID: "c0531ce9-1b32-4c03-b7b0-f84f6da395dd") : secret "dns-default-metrics-tls" not found Jul 06 17:39:30.606438 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:30.606358 2539 generic.go:356] "Generic (PLEG): container finished" podID="787a3934-5d38-4057-99a1-3332f7da451d" containerID="b10b5ed0aa376e27c4d8ea7b823143bfbce1f497438619800adbde2903305cb0" exitCode=0 Jul 06 17:39:30.606562 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:30.606439 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" event={"ID":"787a3934-5d38-4057-99a1-3332f7da451d","Type":"ContainerDied","Data":"b10b5ed0aa376e27c4d8ea7b823143bfbce1f497438619800adbde2903305cb0"} Jul 06 17:39:31.611494 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:31.611411 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" event={"ID":"787a3934-5d38-4057-99a1-3332f7da451d","Type":"ContainerStarted","Data":"5ce78410ef2e844008734cee7492804a0632a4a46abbf907becdd04bc86d998a"} Jul 06 17:39:31.634041 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:31.633991 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xq8hn" podStartSLOduration=9.135668194 podStartE2EDuration="41.633977077s" totalImagesPullingTime="32.498308883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:31.632323358 +0000 UTC m=+41.863568534" watchObservedRunningTime="2026-07-06 17:39:31.633977077 +0000 UTC m=+41.865222252" Jul 06 17:39:31.756729 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:31.756669 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:31.859295 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:31.859258 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:32.614756 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:32.614714 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p6k57" event={"ID":"3bbfc510-7647-447b-b42b-4b309310f1ee","Type":"ContainerStarted","Data":"c1d4b1ef5d735f23b70fd627a9540ac1649ccb27501b9ebe57401f8d593e70f1"} Jul 06 17:39:32.629172 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:32.629089 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p6k57" podStartSLOduration=2.108867989 podStartE2EDuration="6.62907295s" totalImagesPullingTime="4.520204961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:39:32.628310646 +0000 UTC m=+42.859555822" watchObservedRunningTime="2026-07-06 17:39:32.62907295 +0000 UTC m=+42.860318160" Jul 06 17:39:34.363943 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:34.363893 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:34.364411 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:34.364016 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:39:34.364411 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:34.364067 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls podName:c0531ce9-1b32-4c03-b7b0-f84f6da395dd nodeName:}" failed. No retries permitted until 2026-07-06 17:39:42.364053189 +0000 UTC m=+52.595298342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls") pod "dns-default-qgt8l" (UID: "c0531ce9-1b32-4c03-b7b0-f84f6da395dd") : secret "dns-default-metrics-tls" not found Jul 06 17:39:36.443816 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:36.443778 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:36.547328 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:36.547300 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:42.417374 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:42.417340 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:42.417943 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:42.417479 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:39:42.417943 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:42.417562 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls podName:c0531ce9-1b32-4c03-b7b0-f84f6da395dd nodeName:}" failed. No retries permitted until 2026-07-06 17:39:58.417543339 +0000 UTC m=+68.648788494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls") pod "dns-default-qgt8l" (UID: "c0531ce9-1b32-4c03-b7b0-f84f6da395dd") : secret "dns-default-metrics-tls" not found Jul 06 17:39:51.582759 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:51.582731 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rcbtm" Jul 06 17:39:51.704356 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:51.704319 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:51.800816 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:51.800787 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:39:54.996654 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:54.996611 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:54.996654 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:54.996666 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:39:54.999660 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:54.999644 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 17:39:54.999720 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:54.999646 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 17:39:55.007048 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:55.007030 2539 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 17:39:55.007116 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:55.007106 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs podName:a31b714e-0b4b-4193-baf1-4473afd54463 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:59.007086499 +0000 UTC m=+129.238331656 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs") pod "network-metrics-daemon-dpd7c" (UID: "a31b714e-0b4b-4193-baf1-4473afd54463") : secret "metrics-daemon-secret" not found Jul 06 17:39:55.010668 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.010647 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e758f834-160a-40f4-a469-520979a5e4c7-original-pull-secret\") pod \"global-pull-secret-syncer-kd4d2\" (UID: \"e758f834-160a-40f4-a469-520979a5e4c7\") " pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:55.097927 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.097888 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6n79\" (UniqueName: \"kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79\") pod \"network-check-target-jf4ln\" (UID: \"a61eba4f-358c-44d0-84f4-27c49d9eb58c\") " pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:55.100882 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.100867 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 17:39:55.110533 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.110513 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 17:39:55.121140 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.121111 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6n79\" (UniqueName: \"kubernetes.io/projected/a61eba4f-358c-44d0-84f4-27c49d9eb58c-kube-api-access-p6n79\") pod \"network-check-target-jf4ln\" (UID: \"a61eba4f-358c-44d0-84f4-27c49d9eb58c\") " pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:55.210081 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.210043 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kd4d2" Jul 06 17:39:55.219363 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.219341 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jkf68\"" Jul 06 17:39:55.226612 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.226589 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:39:55.355433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.355404 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kd4d2"] Jul 06 17:39:55.359074 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:39:55.359051 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode758f834_160a_40f4_a469_520979a5e4c7.slice/crio-3aa915dde06e11f8a1fc176f00b540f3a8dd3bba019d7307cc0a3b27a9b08696 WatchSource:0}: Error finding container 3aa915dde06e11f8a1fc176f00b540f3a8dd3bba019d7307cc0a3b27a9b08696: Status 404 returned error can't find the container with id 3aa915dde06e11f8a1fc176f00b540f3a8dd3bba019d7307cc0a3b27a9b08696 Jul 06 17:39:55.379595 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.379559 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jf4ln"] Jul 06 17:39:55.384935 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:39:55.384912 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61eba4f_358c_44d0_84f4_27c49d9eb58c.slice/crio-0a1075c8c918d66c6e325161bdb3e0e7a09b0b280adf4158798fc46498a5b528 WatchSource:0}: Error finding container 0a1075c8c918d66c6e325161bdb3e0e7a09b0b280adf4158798fc46498a5b528: Status 404 returned error can't find the container with id 0a1075c8c918d66c6e325161bdb3e0e7a09b0b280adf4158798fc46498a5b528 Jul 06 17:39:55.667232 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.667142 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jf4ln" event={"ID":"a61eba4f-358c-44d0-84f4-27c49d9eb58c","Type":"ContainerStarted","Data":"0a1075c8c918d66c6e325161bdb3e0e7a09b0b280adf4158798fc46498a5b528"} Jul 06 17:39:55.668200 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:55.668177 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kd4d2" event={"ID":"e758f834-160a-40f4-a469-520979a5e4c7","Type":"ContainerStarted","Data":"3aa915dde06e11f8a1fc176f00b540f3a8dd3bba019d7307cc0a3b27a9b08696"} Jul 06 17:39:58.422015 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:58.421973 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:39:58.422462 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:58.422109 2539 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 17:39:58.422462 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:58.422180 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls podName:c0531ce9-1b32-4c03-b7b0-f84f6da395dd nodeName:}" failed. No retries permitted until 2026-07-06 17:40:30.422164544 +0000 UTC m=+100.653409697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls") pod "dns-default-qgt8l" (UID: "c0531ce9-1b32-4c03-b7b0-f84f6da395dd") : secret "dns-default-metrics-tls" not found Jul 06 17:39:59.628925 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.628892 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l"] Jul 06 17:39:59.642414 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.642392 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l"] Jul 06 17:39:59.642545 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.642473 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:39:59.647481 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.647451 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 17:39:59.647615 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.647480 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 17:39:59.647615 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.647506 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 17:39:59.647615 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.647460 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 17:39:59.647615 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.647584 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-578q9\"" Jul 06 17:39:59.730038 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.730010 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/067d2964-906f-4f68-8241-775c582678d9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:39:59.730169 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.730062 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rdnw\" (UniqueName: \"kubernetes.io/projected/067d2964-906f-4f68-8241-775c582678d9-kube-api-access-5rdnw\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:39:59.730169 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.730143 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:39:59.830494 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.830457 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-599fdbdbf7-2z768"] Jul 06 17:39:59.830721 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.830689 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rdnw\" (UniqueName: \"kubernetes.io/projected/067d2964-906f-4f68-8241-775c582678d9-kube-api-access-5rdnw\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:39:59.830773 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.830754 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:39:59.830816 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.830779 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/067d2964-906f-4f68-8241-775c582678d9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:39:59.830945 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:59.830924 2539 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:39:59.831013 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:39:59.831003 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls podName:067d2964-906f-4f68-8241-775c582678d9 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:00.33098549 +0000 UTC m=+70.562230644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t9l7l" (UID: "067d2964-906f-4f68-8241-775c582678d9") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:39:59.831368 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.831348 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/067d2964-906f-4f68-8241-775c582678d9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:39:59.839176 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.839156 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rdnw\" (UniqueName: \"kubernetes.io/projected/067d2964-906f-4f68-8241-775c582678d9-kube-api-access-5rdnw\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:39:59.845053 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.845030 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-599fdbdbf7-2z768"] Jul 06 17:39:59.845165 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.845114 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:39:59.847767 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.847536 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 17:39:59.847767 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.847548 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 17:39:59.847767 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.847579 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-98z8v\"" Jul 06 17:39:59.847767 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.847586 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 17:39:59.848078 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.847779 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 17:39:59.848078 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.847802 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 17:39:59.848169 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.848133 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 17:39:59.932388 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.931430 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:39:59.932388 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.931605 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-default-certificate\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:39:59.932388 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.931643 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:39:59.932388 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.931794 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-stats-auth\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:39:59.932388 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.931834 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9mbt\" (UniqueName: \"kubernetes.io/projected/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-kube-api-access-j9mbt\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:39:59.938491 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:39:59.938449 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:00.032465 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.032389 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:00.032465 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.032451 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-default-certificate\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:00.032465 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.032467 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:00.032718 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.032510 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-stats-auth\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:00.032718 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.032532 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9mbt\" (UniqueName: \"kubernetes.io/projected/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-kube-api-access-j9mbt\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:00.032718 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:00.032540 2539 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:40:00.032718 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:00.032612 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:00.532592025 +0000 UTC m=+70.763837182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : secret "router-metrics-certs-default" not found Jul 06 17:40:00.032718 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:00.032671 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:00.532655121 +0000 UTC m=+70.763900297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : configmap references non-existent config key: service-ca.crt Jul 06 17:40:00.034883 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.034862 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-stats-auth\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:00.035089 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.035069 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-default-certificate\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:00.041982 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.041956 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:00.043992 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.043968 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9mbt\" (UniqueName: \"kubernetes.io/projected/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-kube-api-access-j9mbt\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:00.256632 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.256593 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:00.305085 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.305042 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:00.335227 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.335199 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:40:00.335339 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:00.335310 2539 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:40:00.335375 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:00.335361 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls podName:067d2964-906f-4f68-8241-775c582678d9 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:01.335348343 +0000 UTC m=+71.566593496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t9l7l" (UID: "067d2964-906f-4f68-8241-775c582678d9") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:40:00.536875 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.536778 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:00.536875 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.536848 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:00.537102 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:00.536926 2539 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:40:00.537102 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:00.536984 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:01.536969072 +0000 UTC m=+71.768214225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : secret "router-metrics-certs-default" not found Jul 06 17:40:00.537102 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:00.536999 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:01.536991954 +0000 UTC m=+71.768237107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : configmap references non-existent config key: service-ca.crt Jul 06 17:40:00.681840 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.681804 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jf4ln" event={"ID":"a61eba4f-358c-44d0-84f4-27c49d9eb58c","Type":"ContainerStarted","Data":"b91b92f93db95c97182900f426493581d7cce7ec47155eb80f6dbac1740231f5"} Jul 06 17:40:00.682254 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.681873 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:40:00.683292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.683271 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kd4d2" event={"ID":"e758f834-160a-40f4-a469-520979a5e4c7","Type":"ContainerStarted","Data":"9e9336598c6eb8f885aea928b775343a1d7c25e00f110e66d67367dc024890d4"} Jul 06 17:40:00.697335 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.697285 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jf4ln" podStartSLOduration=66.158016558 podStartE2EDuration="1m10.697271046s" totalImagesPullingTime="4.539254488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:00.69695278 +0000 UTC m=+70.928197960" watchObservedRunningTime="2026-07-06 17:40:00.697271046 +0000 UTC m=+70.928516222" Jul 06 17:40:00.711167 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:00.711118 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kd4d2" podStartSLOduration=66.13408066 podStartE2EDuration="1m10.711104676s" totalImagesPullingTime="4.577024016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:00.710922659 +0000 UTC m=+70.942167834" watchObservedRunningTime="2026-07-06 17:40:00.711104676 +0000 UTC m=+70.942349829" Jul 06 17:40:01.342954 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:01.342916 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:40:01.343206 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:01.343037 2539 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:40:01.343206 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:01.343090 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls podName:067d2964-906f-4f68-8241-775c582678d9 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:03.34307638 +0000 UTC m=+73.574321533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t9l7l" (UID: "067d2964-906f-4f68-8241-775c582678d9") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:40:01.544924 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:01.544882 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:01.545087 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:01.544950 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:01.545087 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:01.545045 2539 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:40:01.545087 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:01.545071 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:03.545052109 +0000 UTC m=+73.776297262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : configmap references non-existent config key: service-ca.crt Jul 06 17:40:01.545199 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:01.545096 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:03.545085544 +0000 UTC m=+73.776330700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : secret "router-metrics-certs-default" not found Jul 06 17:40:03.358056 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:03.358018 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:40:03.358421 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:03.358170 2539 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:40:03.358421 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:03.358236 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls podName:067d2964-906f-4f68-8241-775c582678d9 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:07.358221608 +0000 UTC m=+77.589466761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t9l7l" (UID: "067d2964-906f-4f68-8241-775c582678d9") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:40:03.559795 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:03.559750 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:03.559980 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:03.559827 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:03.559980 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:03.559918 2539 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:40:03.559980 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:03.559972 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:07.559956178 +0000 UTC m=+77.791201331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : configmap references non-existent config key: service-ca.crt Jul 06 17:40:03.560085 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:03.559990 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:07.559981759 +0000 UTC m=+77.791226913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : secret "router-metrics-certs-default" not found Jul 06 17:40:04.818921 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.818891 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t8nnx"] Jul 06 17:40:04.821935 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.821917 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.824580 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.824554 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 17:40:04.825786 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.825740 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 17:40:04.825904 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.825744 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-chbhn\"" Jul 06 17:40:04.825904 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.825835 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 17:40:04.826224 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.826208 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 17:40:04.835241 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.835223 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t8nnx"] Jul 06 17:40:04.869460 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.869423 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzstg\" (UniqueName: \"kubernetes.io/projected/c530330e-41f4-4f28-8886-40595f987595-kube-api-access-fzstg\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.869460 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.869463 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c530330e-41f4-4f28-8886-40595f987595-crio-socket\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.869614 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.869492 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.869614 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.869527 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c530330e-41f4-4f28-8886-40595f987595-data-volume\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.869614 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.869592 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.926099 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.926068 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:04.970174 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.970146 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzstg\" (UniqueName: \"kubernetes.io/projected/c530330e-41f4-4f28-8886-40595f987595-kube-api-access-fzstg\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.970246 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.970180 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c530330e-41f4-4f28-8886-40595f987595-crio-socket\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.970246 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.970201 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.970246 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.970221 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c530330e-41f4-4f28-8886-40595f987595-data-volume\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.970353 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.970281 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c530330e-41f4-4f28-8886-40595f987595-crio-socket\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.970353 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.970283 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.970353 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:04.970326 2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:40:04.970353 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:04.970326 2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:40:04.970478 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:04.970394 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:05.470374368 +0000 UTC m=+75.701619525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : secret "insights-runtime-extractor-tls" not found Jul 06 17:40:04.970478 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:04.970409 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:05.470403101 +0000 UTC m=+75.701648254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : configmap "kube-rbac-proxy" not found Jul 06 17:40:04.970592 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.970576 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c530330e-41f4-4f28-8886-40595f987595-data-volume\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:04.978934 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:04.978905 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzstg\" (UniqueName: \"kubernetes.io/projected/c530330e-41f4-4f28-8886-40595f987595-kube-api-access-fzstg\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:05.474169 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:05.474122 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:05.474343 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:05.474198 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:05.474343 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:05.474259 2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:40:05.474343 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:05.474294 2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:40:05.474343 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:05.474338 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:06.474322226 +0000 UTC m=+76.705567381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : configmap "kube-rbac-proxy" not found Jul 06 17:40:05.474480 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:05.474358 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:06.474345213 +0000 UTC m=+76.705590366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : secret "insights-runtime-extractor-tls" not found Jul 06 17:40:06.481602 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:06.481562 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:06.482006 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:06.481661 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:06.482006 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:06.481747 2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:40:06.482006 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:06.481777 2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:40:06.482006 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:06.481810 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:08.481794762 +0000 UTC m=+78.713039916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : secret "insights-runtime-extractor-tls" not found Jul 06 17:40:06.482006 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:06.481829 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:08.481816763 +0000 UTC m=+78.713061919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : configmap "kube-rbac-proxy" not found Jul 06 17:40:06.793376 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:06.793302 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pjllx_eba56436-f6d7-4268-a036-476e9da0943e/dns-node-resolver/0.log" Jul 06 17:40:07.389127 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:07.389087 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:40:07.389291 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:07.389226 2539 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:40:07.389291 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:07.389288 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls podName:067d2964-906f-4f68-8241-775c582678d9 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:15.389273381 +0000 UTC m=+85.620518557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t9l7l" (UID: "067d2964-906f-4f68-8241-775c582678d9") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:40:07.590405 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:07.590374 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:07.590765 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:07.590433 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:07.590765 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:07.590514 2539 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:40:07.590765 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:07.590560 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:15.59054647 +0000 UTC m=+85.821791625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : configmap references non-existent config key: service-ca.crt Jul 06 17:40:07.590765 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:07.590577 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:15.590569912 +0000 UTC m=+85.821815066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : secret "router-metrics-certs-default" not found Jul 06 17:40:07.591874 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:07.591851 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gx4hg_1a4e159e-96e1-4c0c-a18c-223035520e0e/node-ca/0.log" Jul 06 17:40:08.496497 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:08.496461 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:08.496681 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:08.496538 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:08.496681 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:08.496598 2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:40:08.496681 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:08.496623 2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:40:08.496681 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:08.496657 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:12.496643676 +0000 UTC m=+82.727888829 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : secret "insights-runtime-extractor-tls" not found Jul 06 17:40:08.496681 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:08.496678 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:12.496663887 +0000 UTC m=+82.727909040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : configmap "kube-rbac-proxy" not found Jul 06 17:40:08.592126 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:08.592089 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p6k57_3bbfc510-7647-447b-b42b-4b309310f1ee/serve-healthcheck-canary/0.log" Jul 06 17:40:09.333748 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:09.333716 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:09.434635 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:09.434601 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:12.526661 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:12.526528 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:12.526661 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:12.526608 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:12.526661 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:12.526646 2539 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 17:40:12.527210 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:12.526729 2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:40:12.527210 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:12.526738 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:20.526718829 +0000 UTC m=+90.757963982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : configmap "kube-rbac-proxy" not found Jul 06 17:40:12.527210 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:12.526781 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:20.526765714 +0000 UTC m=+90.758010867 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : secret "insights-runtime-extractor-tls" not found Jul 06 17:40:14.622018 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.621991 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8"] Jul 06 17:40:14.624867 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.624847 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8" Jul 06 17:40:14.624999 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.624847 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:14.628399 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.628371 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 17:40:14.628815 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.628798 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 17:40:14.629096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.628822 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4chmq\"" Jul 06 17:40:14.635489 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.635468 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8"] Jul 06 17:40:14.640670 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.640651 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv827\" (UniqueName: \"kubernetes.io/projected/90b18a10-eb9b-4b74-8698-9aff666d52d8-kube-api-access-lv827\") pod \"migrator-d57d58cc9-gs5p8\" (UID: \"90b18a10-eb9b-4b74-8698-9aff666d52d8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8" Jul 06 17:40:14.687200 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.687171 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:14.741178 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.741158 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv827\" (UniqueName: \"kubernetes.io/projected/90b18a10-eb9b-4b74-8698-9aff666d52d8-kube-api-access-lv827\") pod \"migrator-d57d58cc9-gs5p8\" (UID: \"90b18a10-eb9b-4b74-8698-9aff666d52d8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8" Jul 06 17:40:14.741984 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.741959 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:14.749449 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.749433 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv827\" (UniqueName: \"kubernetes.io/projected/90b18a10-eb9b-4b74-8698-9aff666d52d8-kube-api-access-lv827\") pod \"migrator-d57d58cc9-gs5p8\" (UID: \"90b18a10-eb9b-4b74-8698-9aff666d52d8\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8" Jul 06 17:40:14.851303 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.851275 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74d4db7868-x5xm7"] Jul 06 17:40:14.853229 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.853212 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:14.855737 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.855711 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 17:40:14.855835 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.855821 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 17:40:14.855904 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.855847 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 17:40:14.856089 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.856073 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p5ww8\"" Jul 06 17:40:14.860374 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.860359 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 17:40:14.866907 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.866888 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74d4db7868-x5xm7"] Jul 06 17:40:14.936682 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.936663 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8" Jul 06 17:40:14.942434 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.942415 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-image-registry-private-configuration\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:14.942533 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.942461 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbp9q\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-kube-api-access-qbp9q\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:14.942575 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.942528 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9018e0d-4d7d-40f6-b479-d895624c9258-ca-trust-extracted\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:14.942613 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.942571 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-installation-pull-secrets\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:14.942662 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.942610 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:14.942734 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.942710 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-certificates\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:14.942790 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.942757 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-trusted-ca\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:14.942843 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.942789 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-bound-sa-token\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:14.956331 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:14.956306 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:15.006638 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.006610 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:15.043557 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.043530 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9018e0d-4d7d-40f6-b479-d895624c9258-ca-trust-extracted\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.043667 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.043563 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-installation-pull-secrets\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.043667 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.043587 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.043667 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.043620 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-certificates\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.043667 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.043642 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-trusted-ca\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.043667 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.043659 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-bound-sa-token\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.043902 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.043728 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-image-registry-private-configuration\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.043902 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.043775 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbp9q\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-kube-api-access-qbp9q\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.043902 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.043783 2539 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:40:15.043902 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.043802 2539 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d4db7868-x5xm7: secret "image-registry-tls" not found Jul 06 17:40:15.043902 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.043862 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls podName:a9018e0d-4d7d-40f6-b479-d895624c9258 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:15.543846607 +0000 UTC m=+85.775091760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls") pod "image-registry-74d4db7868-x5xm7" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258") : secret "image-registry-tls" not found Jul 06 17:40:15.044102 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.043935 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9018e0d-4d7d-40f6-b479-d895624c9258-ca-trust-extracted\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.044420 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.044401 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-certificates\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.044829 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.044811 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-trusted-ca\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.046224 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.046208 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-installation-pull-secrets\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.046330 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.046252 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-image-registry-private-configuration\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.050609 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.050544 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8"] Jul 06 17:40:15.054126 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:15.054092 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b18a10_eb9b_4b74_8698_9aff666d52d8.slice/crio-267be3923bfbf44e0c1d38bbe2921f3fcba2435747808418e66b5d37ae477551 WatchSource:0}: Error finding container 267be3923bfbf44e0c1d38bbe2921f3fcba2435747808418e66b5d37ae477551: Status 404 returned error can't find the container with id 267be3923bfbf44e0c1d38bbe2921f3fcba2435747808418e66b5d37ae477551 Jul 06 17:40:15.054676 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.054649 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-bound-sa-token\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.055423 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.055397 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbp9q\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-kube-api-access-qbp9q\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.387140 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.387050 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:15.447124 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.447096 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:40:15.447238 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.447222 2539 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 17:40:15.447304 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.447295 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls podName:067d2964-906f-4f68-8241-775c582678d9 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:31.447277555 +0000 UTC m=+101.678522709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-t9l7l" (UID: "067d2964-906f-4f68-8241-775c582678d9") : secret "cluster-monitoring-operator-tls" not found Jul 06 17:40:15.548258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.548230 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:15.548342 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.548322 2539 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:40:15.548342 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.548335 2539 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d4db7868-x5xm7: secret "image-registry-tls" not found Jul 06 17:40:15.548460 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.548373 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls podName:a9018e0d-4d7d-40f6-b479-d895624c9258 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:16.54836234 +0000 UTC m=+86.779607496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls") pod "image-registry-74d4db7868-x5xm7" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258") : secret "image-registry-tls" not found Jul 06 17:40:15.648627 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.648573 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:15.648627 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.648604 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:15.648995 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.648723 2539 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 17:40:15.648995 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.648762 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:31.648751243 +0000 UTC m=+101.879996396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : configmap references non-existent config key: service-ca.crt Jul 06 17:40:15.648995 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:15.648779 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs podName:8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:31.648772073 +0000 UTC m=+101.880017227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs") pod "router-default-599fdbdbf7-2z768" (UID: "8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1") : secret "router-metrics-certs-default" not found Jul 06 17:40:15.664826 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.664801 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:15.719955 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.719925 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8" event={"ID":"90b18a10-eb9b-4b74-8698-9aff666d52d8","Type":"ContainerStarted","Data":"267be3923bfbf44e0c1d38bbe2921f3fcba2435747808418e66b5d37ae477551"} Jul 06 17:40:15.765746 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:15.765723 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:16.556414 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:16.556384 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:16.556578 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:16.556559 2539 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:40:16.556619 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:16.556581 2539 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d4db7868-x5xm7: secret "image-registry-tls" not found Jul 06 17:40:16.556651 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:16.556637 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls podName:a9018e0d-4d7d-40f6-b479-d895624c9258 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:18.556623861 +0000 UTC m=+88.787869014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls") pod "image-registry-74d4db7868-x5xm7" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258") : secret "image-registry-tls" not found Jul 06 17:40:16.724682 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:16.724653 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8" event={"ID":"90b18a10-eb9b-4b74-8698-9aff666d52d8","Type":"ContainerStarted","Data":"32a2ae7ac86028b3f04354af0b5955dafa0b0bd7945aa17591001fddf4463d88"} Jul 06 17:40:16.725078 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:16.724793 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8" event={"ID":"90b18a10-eb9b-4b74-8698-9aff666d52d8","Type":"ContainerStarted","Data":"4ed16dac1d3155c073e647c4661d21cf04c2cdc335c0b95b852e5fc3be2e72d6"} Jul 06 17:40:16.739478 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:16.739435 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-gs5p8" podStartSLOduration=1.210950948 podStartE2EDuration="2.739422602s" totalImagesPullingTime="1.528471654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:16.738377383 +0000 UTC m=+86.969622573" watchObservedRunningTime="2026-07-06 17:40:16.739422602 +0000 UTC m=+86.970667776" Jul 06 17:40:16.808665 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:16.808610 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:16.858438 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:16.858416 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:17.313603 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:17.313569 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:17.364056 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:17.364031 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:18.050241 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:18.050202 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:18.537907 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:18.537876 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:18.571527 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:18.571497 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:18.571670 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:18.571639 2539 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:40:18.571670 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:18.571656 2539 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d4db7868-x5xm7: secret "image-registry-tls" not found Jul 06 17:40:18.571800 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:18.571746 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls podName:a9018e0d-4d7d-40f6-b479-d895624c9258 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:22.571726919 +0000 UTC m=+92.802972089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls") pod "image-registry-74d4db7868-x5xm7" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258") : secret "image-registry-tls" not found Jul 06 17:40:20.585974 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:20.585930 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:20.586368 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:20.586006 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:20.586368 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:20.586136 2539 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 17:40:20.586368 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:20.586195 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls podName:c530330e-41f4-4f28-8886-40595f987595 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:36.586181167 +0000 UTC m=+106.817426320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t8nnx" (UID: "c530330e-41f4-4f28-8886-40595f987595") : secret "insights-runtime-extractor-tls" not found Jul 06 17:40:20.586481 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:20.586370 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c530330e-41f4-4f28-8886-40595f987595-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:20.691095 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:20.691068 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:20.790283 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:20.790246 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:20.891417 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:20.891347 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:21.020633 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:21.020608 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:21.120076 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:21.120054 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:21.220893 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:21.220872 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:21.320316 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:21.320296 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:21.939146 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:21.939114 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:22.340102 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:22.340015 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:22.601318 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:22.601241 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:22.601454 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:22.601362 2539 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 17:40:22.601454 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:22.601375 2539 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74d4db7868-x5xm7: secret "image-registry-tls" not found Jul 06 17:40:22.601454 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:22.601422 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls podName:a9018e0d-4d7d-40f6-b479-d895624c9258 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:30.601409699 +0000 UTC m=+100.832654853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls") pod "image-registry-74d4db7868-x5xm7" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258") : secret "image-registry-tls" not found Jul 06 17:40:22.742752 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:22.742725 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:22.935016 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:22.934980 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:23.334538 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:23.334465 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:23.942148 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:23.942112 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:24.334345 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:24.334272 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:24.529883 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:24.529856 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:24.740771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:24.740739 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:24.839348 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:24.839322 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:24.938356 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:24.938337 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:25.338285 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:25.338261 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:25.391353 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:25.391325 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:25.931606 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:25.931575 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:26.538359 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:26.538320 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:26.737156 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:26.737111 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:26.934715 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:26.934671 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:27.053401 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:27.053372 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:27.154319 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:27.154293 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:28.131930 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:28.131892 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:28.533048 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:28.533018 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:28.749316 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:28.749283 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:28.935639 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:28.935605 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:29.134645 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:29.134620 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:30.133131 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.133098 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:30.459844 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.459816 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:40:30.462100 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.462081 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0531ce9-1b32-4c03-b7b0-f84f6da395dd-metrics-tls\") pod \"dns-default-qgt8l\" (UID: \"c0531ce9-1b32-4c03-b7b0-f84f6da395dd\") " pod="openshift-dns/dns-default-qgt8l" Jul 06 17:40:30.533429 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.533406 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:30.539272 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.539257 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-75j6z\"" Jul 06 17:40:30.547297 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.547285 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgt8l" Jul 06 17:40:30.662258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.662229 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:30.664505 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.664483 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls\") pod \"image-registry-74d4db7868-x5xm7\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:30.706643 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.706622 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgt8l"] Jul 06 17:40:30.712168 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:30.712117 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0531ce9_1b32_4c03_b7b0_f84f6da395dd.slice/crio-a5f9385ed2b47aebf3337545b862559d439f4aa864ec78a81fe665b31b1fbb54 WatchSource:0}: Error finding container a5f9385ed2b47aebf3337545b862559d439f4aa864ec78a81fe665b31b1fbb54: Status 404 returned error can't find the container with id a5f9385ed2b47aebf3337545b862559d439f4aa864ec78a81fe665b31b1fbb54 Jul 06 17:40:30.738580 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.738554 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:30.761634 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.761617 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:30.762617 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.762596 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgt8l" event={"ID":"c0531ce9-1b32-4c03-b7b0-f84f6da395dd","Type":"ContainerStarted","Data":"a5f9385ed2b47aebf3337545b862559d439f4aa864ec78a81fe665b31b1fbb54"} Jul 06 17:40:30.918554 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.918529 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74d4db7868-x5xm7"] Jul 06 17:40:30.921712 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:30.921676 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9018e0d_4d7d_40f6_b479_d895624c9258.slice/crio-247322f2537aa8f7477378fc1bc89fda70cc98dcd263c07c7d3b8b3b430ea351 WatchSource:0}: Error finding container 247322f2537aa8f7477378fc1bc89fda70cc98dcd263c07c7d3b8b3b430ea351: Status 404 returned error can't find the container with id 247322f2537aa8f7477378fc1bc89fda70cc98dcd263c07c7d3b8b3b430ea351 Jul 06 17:40:30.943333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:30.943308 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:31.139306 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.139280 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:31.469052 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.469021 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:40:31.471693 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.471673 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/067d2964-906f-4f68-8241-775c582678d9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-t9l7l\" (UID: \"067d2964-906f-4f68-8241-775c582678d9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:40:31.532597 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.532555 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:31.671094 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.671058 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:31.671255 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.671101 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:31.671785 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.671765 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-service-ca-bundle\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:31.673795 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.673773 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1-metrics-certs\") pod \"router-default-599fdbdbf7-2z768\" (UID: \"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1\") " pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:31.687791 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.687770 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jf4ln" Jul 06 17:40:31.752037 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.751976 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" Jul 06 17:40:31.766897 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.766875 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" event={"ID":"a9018e0d-4d7d-40f6-b479-d895624c9258","Type":"ContainerStarted","Data":"f2c52add09271c03535fb56a5ae4c8d14ac60c36f31f0ea73eab11267eaec54a"} Jul 06 17:40:31.767016 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.766916 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" event={"ID":"a9018e0d-4d7d-40f6-b479-d895624c9258","Type":"ContainerStarted","Data":"247322f2537aa8f7477378fc1bc89fda70cc98dcd263c07c7d3b8b3b430ea351"} Jul 06 17:40:31.767016 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.766959 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:31.785287 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.785245 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" podStartSLOduration=17.785231261 podStartE2EDuration="17.785231261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:31.784207859 +0000 UTC m=+102.015453033" watchObservedRunningTime="2026-07-06 17:40:31.785231261 +0000 UTC m=+102.016476435" Jul 06 17:40:31.914097 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.914068 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l"] Jul 06 17:40:31.917063 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:31.917035 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067d2964_906f_4f68_8241_775c582678d9.slice/crio-e4ea4bf59282e30c0addfb216ef858a0b21e5c00f5ac952d9a9bf5b4262de220 WatchSource:0}: Error finding container e4ea4bf59282e30c0addfb216ef858a0b21e5c00f5ac952d9a9bf5b4262de220: Status 404 returned error can't find the container with id e4ea4bf59282e30c0addfb216ef858a0b21e5c00f5ac952d9a9bf5b4262de220 Jul 06 17:40:31.953980 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:31.953961 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:32.073841 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:32.073806 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-599fdbdbf7-2z768"] Jul 06 17:40:32.077333 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:32.077304 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc99cc9_00b5_42ba_ac0a_1edb0b5122d1.slice/crio-62bd713fedf092a1678f16de719e10bcb18fd1fa361ecec6574aa2e4b36fb1ba WatchSource:0}: Error finding container 62bd713fedf092a1678f16de719e10bcb18fd1fa361ecec6574aa2e4b36fb1ba: Status 404 returned error can't find the container with id 62bd713fedf092a1678f16de719e10bcb18fd1fa361ecec6574aa2e4b36fb1ba Jul 06 17:40:32.771976 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:32.771927 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" event={"ID":"067d2964-906f-4f68-8241-775c582678d9","Type":"ContainerStarted","Data":"e4ea4bf59282e30c0addfb216ef858a0b21e5c00f5ac952d9a9bf5b4262de220"} Jul 06 17:40:32.773736 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:32.773687 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-599fdbdbf7-2z768" event={"ID":"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1","Type":"ContainerStarted","Data":"cb77bd57be44f25c47b0fd03fce11dcd90c6e7d9028c58872e668e5fb8997f78"} Jul 06 17:40:32.773865 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:32.773759 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-599fdbdbf7-2z768" event={"ID":"8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1","Type":"ContainerStarted","Data":"62bd713fedf092a1678f16de719e10bcb18fd1fa361ecec6574aa2e4b36fb1ba"} Jul 06 17:40:32.795678 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:32.795624 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-599fdbdbf7-2z768" podStartSLOduration=33.795604248 podStartE2EDuration="33.795604248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:32.793441977 +0000 UTC m=+103.024687151" watchObservedRunningTime="2026-07-06 17:40:32.795604248 +0000 UTC m=+103.026849444" Jul 06 17:40:32.954794 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:32.954623 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:32.957954 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:32.957933 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:33.778117 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:33.778081 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgt8l" event={"ID":"c0531ce9-1b32-4c03-b7b0-f84f6da395dd","Type":"ContainerStarted","Data":"93cdb26eac203d881446972a368bf4ef37ed7bc3a13d8a1106e8ca02cba21bdb"} Jul 06 17:40:33.778619 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:33.778140 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgt8l" event={"ID":"c0531ce9-1b32-4c03-b7b0-f84f6da395dd","Type":"ContainerStarted","Data":"73caadf76e84c744a996d1ab8454dd97708331af8477c9b2575df2ae33dbe055"} Jul 06 17:40:33.778619 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:33.778195 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qgt8l" Jul 06 17:40:33.778619 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:33.778240 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:33.779643 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:33.779626 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-599fdbdbf7-2z768" Jul 06 17:40:33.795355 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:33.795309 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qgt8l" podStartSLOduration=65.654520809 podStartE2EDuration="1m7.795292196s" totalImagesPullingTime="2.140771387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:39:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:33.794490971 +0000 UTC m=+104.025736155" watchObservedRunningTime="2026-07-06 17:40:33.795292196 +0000 UTC m=+104.026537370" Jul 06 17:40:34.535169 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:34.535043 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:34.634881 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:34.634844 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:34.735896 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:34.735866 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:34.782684 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:34.782645 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" event={"ID":"067d2964-906f-4f68-8241-775c582678d9","Type":"ContainerStarted","Data":"fd40b0a10a35bc6884813ea7fcded466939fdcea1d75e52abb729c86c136a127"} Jul 06 17:40:34.798218 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:34.798124 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-t9l7l" podStartSLOduration=33.482432203 podStartE2EDuration="35.798108768s" totalImagesPullingTime="2.315676565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:39:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:34.797482205 +0000 UTC m=+105.028727374" watchObservedRunningTime="2026-07-06 17:40:34.798108768 +0000 UTC m=+105.029353945" Jul 06 17:40:35.004865 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:35.004830 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:36.606927 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.606870 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:36.610205 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.610173 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c530330e-41f4-4f28-8886-40595f987595-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t8nnx\" (UID: \"c530330e-41f4-4f28-8886-40595f987595\") " pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:36.631214 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.631182 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t8nnx" Jul 06 17:40:36.660880 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.660853 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74d4db7868-x5xm7"] Jul 06 17:40:36.715390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.715345 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78df6d6598-snpwv"] Jul 06 17:40:36.717568 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.717547 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.734602 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.734581 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78df6d6598-snpwv"] Jul 06 17:40:36.782319 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.782296 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t8nnx"] Jul 06 17:40:36.783771 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:36.783748 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc530330e_41f4_4f28_8886_40595f987595.slice/crio-2abad11befbbb34e85e580cf4dc3ce2fc00f1525134aa0427214a9c7b271df0b WatchSource:0}: Error finding container 2abad11befbbb34e85e580cf4dc3ce2fc00f1525134aa0427214a9c7b271df0b: Status 404 returned error can't find the container with id 2abad11befbbb34e85e580cf4dc3ce2fc00f1525134aa0427214a9c7b271df0b Jul 06 17:40:36.789266 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.789243 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8nnx" event={"ID":"c530330e-41f4-4f28-8886-40595f987595","Type":"ContainerStarted","Data":"2abad11befbbb34e85e580cf4dc3ce2fc00f1525134aa0427214a9c7b271df0b"} Jul 06 17:40:36.794101 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.794075 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:36.808014 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.807993 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/718ef886-2d81-4d59-9145-a097a0c60b88-ca-trust-extracted\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.808109 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.808046 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/718ef886-2d81-4d59-9145-a097a0c60b88-registry-tls\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.808109 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.808064 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/718ef886-2d81-4d59-9145-a097a0c60b88-registry-certificates\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.808205 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.808106 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9289r\" (UniqueName: \"kubernetes.io/projected/718ef886-2d81-4d59-9145-a097a0c60b88-kube-api-access-9289r\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.808205 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.808143 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/718ef886-2d81-4d59-9145-a097a0c60b88-installation-pull-secrets\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.808310 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.808201 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/718ef886-2d81-4d59-9145-a097a0c60b88-trusted-ca\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.808310 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.808231 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/718ef886-2d81-4d59-9145-a097a0c60b88-bound-sa-token\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.808310 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.808297 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/718ef886-2d81-4d59-9145-a097a0c60b88-image-registry-private-configuration\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.889667 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.889605 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:36.909499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.909478 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/718ef886-2d81-4d59-9145-a097a0c60b88-image-registry-private-configuration\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.909584 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.909506 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/718ef886-2d81-4d59-9145-a097a0c60b88-ca-trust-extracted\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.909584 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.909546 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/718ef886-2d81-4d59-9145-a097a0c60b88-registry-tls\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.909584 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.909566 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/718ef886-2d81-4d59-9145-a097a0c60b88-registry-certificates\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.909763 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.909590 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9289r\" (UniqueName: \"kubernetes.io/projected/718ef886-2d81-4d59-9145-a097a0c60b88-kube-api-access-9289r\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.909763 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.909608 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/718ef886-2d81-4d59-9145-a097a0c60b88-installation-pull-secrets\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.909763 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.909624 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/718ef886-2d81-4d59-9145-a097a0c60b88-trusted-ca\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.909763 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.909638 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/718ef886-2d81-4d59-9145-a097a0c60b88-bound-sa-token\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.909952 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.909902 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/718ef886-2d81-4d59-9145-a097a0c60b88-ca-trust-extracted\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.910719 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.910664 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/718ef886-2d81-4d59-9145-a097a0c60b88-registry-certificates\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.910875 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.910856 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/718ef886-2d81-4d59-9145-a097a0c60b88-trusted-ca\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.912042 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.912022 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/718ef886-2d81-4d59-9145-a097a0c60b88-image-registry-private-configuration\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.912126 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.912045 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/718ef886-2d81-4d59-9145-a097a0c60b88-installation-pull-secrets\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.912126 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.912107 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/718ef886-2d81-4d59-9145-a097a0c60b88-registry-tls\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.918975 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.918956 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9289r\" (UniqueName: \"kubernetes.io/projected/718ef886-2d81-4d59-9145-a097a0c60b88-kube-api-access-9289r\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:36.919142 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:36.919125 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/718ef886-2d81-4d59-9145-a097a0c60b88-bound-sa-token\") pod \"image-registry-78df6d6598-snpwv\" (UID: \"718ef886-2d81-4d59-9145-a097a0c60b88\") " pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:37.028811 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:37.028784 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:37.151834 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:37.151761 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78df6d6598-snpwv"] Jul 06 17:40:37.154349 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:37.154323 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718ef886_2d81_4d59_9145_a097a0c60b88.slice/crio-fa9ecc06526232144c40153d8204b187597542d3df4a827a42585713b9472ebc WatchSource:0}: Error finding container fa9ecc06526232144c40153d8204b187597542d3df4a827a42585713b9472ebc: Status 404 returned error can't find the container with id fa9ecc06526232144c40153d8204b187597542d3df4a827a42585713b9472ebc Jul 06 17:40:37.795382 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:37.795350 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78df6d6598-snpwv" event={"ID":"718ef886-2d81-4d59-9145-a097a0c60b88","Type":"ContainerStarted","Data":"db829af77e7a13706a026b5c22e91f7b6a4c8b102b793a02460edc295f4f2862"} Jul 06 17:40:37.795846 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:37.795424 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78df6d6598-snpwv" event={"ID":"718ef886-2d81-4d59-9145-a097a0c60b88","Type":"ContainerStarted","Data":"fa9ecc06526232144c40153d8204b187597542d3df4a827a42585713b9472ebc"} Jul 06 17:40:37.796111 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:37.796092 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:37.818281 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:37.818233 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78df6d6598-snpwv" podStartSLOduration=1.818219707 podStartE2EDuration="1.818219707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:37.816332846 +0000 UTC m=+108.047578019" watchObservedRunningTime="2026-07-06 17:40:37.818219707 +0000 UTC m=+108.049464881" Jul 06 17:40:38.018414 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:38.018372 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:39.495354 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:39.495319 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:39.561333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:39.561228 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:39.629852 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:39.629805 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:39.731545 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:39.731510 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:39.795060 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:39.794980 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:39.858156 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:39.858112 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:39.911411 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:39.911370 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:40.726579 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:40.726539 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:40.806395 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:40.806359 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8nnx" event={"ID":"c530330e-41f4-4f28-8886-40595f987595","Type":"ContainerStarted","Data":"52eb619ab399bb71338f25e7323b96c70837c060aa244ab6ee447d57e736a377"} Jul 06 17:40:41.812501 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:41.812464 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8nnx" event={"ID":"c530330e-41f4-4f28-8886-40595f987595","Type":"ContainerStarted","Data":"31ce4677ff9a80a7c4a41f64f5b654d74dd111c5f8db3185b3b0ff3cb5bd3708"} Jul 06 17:40:43.785435 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:43.785360 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qgt8l" Jul 06 17:40:43.821029 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:43.820993 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t8nnx" event={"ID":"c530330e-41f4-4f28-8886-40595f987595","Type":"ContainerStarted","Data":"e1e38e2dffffa5cad4a1bf7bd8bd302beb545947e287b1b2a2f5d9df8a80ad7b"} Jul 06 17:40:43.840146 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:43.840099 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t8nnx" podStartSLOduration=33.230053675 podStartE2EDuration="39.840084895s" totalImagesPullingTime="6.61003122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:43.839095069 +0000 UTC m=+114.070340255" watchObservedRunningTime="2026-07-06 17:40:43.840084895 +0000 UTC m=+114.071330129" Jul 06 17:40:44.951910 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:44.951874 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:45.731120 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:45.731081 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:45.787348 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:45.787307 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:46.092560 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:46.092480 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:46.144397 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:46.144363 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:46.666992 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:46.666948 2539 patch_prober.go:28] interesting pod/image-registry-74d4db7868-x5xm7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 17:40:46.667147 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:46.667003 2539 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" podUID="a9018e0d-4d7d-40f6-b479-d895624c9258" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 17:40:46.846608 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:46.846578 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:47.067834 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.067776 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:47.118247 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.118208 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9"] Jul 06 17:40:47.121611 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.121586 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.125753 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.125735 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 17:40:47.125850 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.125796 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 17:40:47.125850 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.125843 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mpsh7\"" Jul 06 17:40:47.125973 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.125856 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 17:40:47.125973 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.125919 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 17:40:47.131366 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.131342 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9"] Jul 06 17:40:47.134592 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.134570 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tdd7z"] Jul 06 17:40:47.136536 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.136521 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.139326 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.139310 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 17:40:47.139424 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.139311 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 17:40:47.139424 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.139328 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8fxcc\"" Jul 06 17:40:47.139555 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.139539 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 17:40:47.155529 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.155501 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:47.192992 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.192966 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/080c2129-ddd3-4dd4-88ab-eca13e82466a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.193118 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.193001 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nqs4\" (UniqueName: \"kubernetes.io/projected/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-api-access-8nqs4\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.193118 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.193045 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.193118 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.193072 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.193118 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.193096 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/080c2129-ddd3-4dd4-88ab-eca13e82466a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.193258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.193120 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.221719 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.221669 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:47.293962 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.293929 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-tls\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.294102 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.293979 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.294102 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294005 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.294102 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294022 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.294102 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294043 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/080c2129-ddd3-4dd4-88ab-eca13e82466a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.294102 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294061 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.294327 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294197 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-wtmp\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.294327 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294241 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-textfile\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.294327 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294292 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/080c2129-ddd3-4dd4-88ab-eca13e82466a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.294469 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294337 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nqs4\" (UniqueName: \"kubernetes.io/projected/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-api-access-8nqs4\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.294469 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294367 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16f4765-835f-4182-929a-7f979fc67cca-metrics-client-ca\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.294469 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294405 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f16f4765-835f-4182-929a-7f979fc67cca-root\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.294469 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294439 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f16f4765-835f-4182-929a-7f979fc67cca-sys\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.294660 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294468 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-accelerators-collector-config\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.294660 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294499 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nmpz\" (UniqueName: \"kubernetes.io/projected/f16f4765-835f-4182-929a-7f979fc67cca-kube-api-access-6nmpz\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.294660 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.294526 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/080c2129-ddd3-4dd4-88ab-eca13e82466a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.295055 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.295033 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/080c2129-ddd3-4dd4-88ab-eca13e82466a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.295135 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.295072 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.296572 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.296551 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.296736 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.296690 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.304450 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.304427 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nqs4\" (UniqueName: \"kubernetes.io/projected/080c2129-ddd3-4dd4-88ab-eca13e82466a-kube-api-access-8nqs4\") pod \"kube-state-metrics-7c9dbb8b7d-fbqj9\" (UID: \"080c2129-ddd3-4dd4-88ab-eca13e82466a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.321888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.321821 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:47.395583 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395548 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.395583 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395589 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-wtmp\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.395777 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395606 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-textfile\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.395777 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395753 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16f4765-835f-4182-929a-7f979fc67cca-metrics-client-ca\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.395777 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395766 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-wtmp\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.395894 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395820 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f16f4765-835f-4182-929a-7f979fc67cca-root\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.395894 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395857 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f16f4765-835f-4182-929a-7f979fc67cca-sys\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.395894 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395885 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-accelerators-collector-config\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.396032 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395909 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nmpz\" (UniqueName: \"kubernetes.io/projected/f16f4765-835f-4182-929a-7f979fc67cca-kube-api-access-6nmpz\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.396032 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395932 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-textfile\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.396032 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395937 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-tls\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.396032 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395939 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f16f4765-835f-4182-929a-7f979fc67cca-root\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.396032 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.395941 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f16f4765-835f-4182-929a-7f979fc67cca-sys\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.396292 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.396275 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f16f4765-835f-4182-929a-7f979fc67cca-metrics-client-ca\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.396361 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.396343 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-accelerators-collector-config\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.398279 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.398253 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.398374 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.398253 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f16f4765-835f-4182-929a-7f979fc67cca-node-exporter-tls\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.405718 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.405661 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:47.406765 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.406743 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nmpz\" (UniqueName: \"kubernetes.io/projected/f16f4765-835f-4182-929a-7f979fc67cca-kube-api-access-6nmpz\") pod \"node-exporter-tdd7z\" (UID: \"f16f4765-835f-4182-929a-7f979fc67cca\") " pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.430456 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.430428 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" Jul 06 17:40:47.445198 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.445174 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tdd7z" Jul 06 17:40:47.453787 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:47.453760 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16f4765_835f_4182_929a_7f979fc67cca.slice/crio-8bfb052f78a58f4d2c1936137852441996ae447ac96c4683a703d12b30b65697 WatchSource:0}: Error finding container 8bfb052f78a58f4d2c1936137852441996ae447ac96c4683a703d12b30b65697: Status 404 returned error can't find the container with id 8bfb052f78a58f4d2c1936137852441996ae447ac96c4683a703d12b30b65697 Jul 06 17:40:47.464267 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.464235 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:47.562397 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.562365 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9"] Jul 06 17:40:47.565186 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:47.565150 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080c2129_ddd3_4dd4_88ab_eca13e82466a.slice/crio-a3d64206c273979e6376bea41f04cc42e2102d4d3a42b7fd6611593af6320bab WatchSource:0}: Error finding container a3d64206c273979e6376bea41f04cc42e2102d4d3a42b7fd6611593af6320bab: Status 404 returned error can't find the container with id a3d64206c273979e6376bea41f04cc42e2102d4d3a42b7fd6611593af6320bab Jul 06 17:40:47.835611 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.835578 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" event={"ID":"080c2129-ddd3-4dd4-88ab-eca13e82466a","Type":"ContainerStarted","Data":"a3d64206c273979e6376bea41f04cc42e2102d4d3a42b7fd6611593af6320bab"} Jul 06 17:40:47.836769 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:47.836743 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdd7z" event={"ID":"f16f4765-835f-4182-929a-7f979fc67cca","Type":"ContainerStarted","Data":"8bfb052f78a58f4d2c1936137852441996ae447ac96c4683a703d12b30b65697"} Jul 06 17:40:48.037501 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.037465 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:48.139802 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.139692 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:48.155314 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.155282 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:40:48.159409 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.159386 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.162221 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.162193 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 17:40:48.162339 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.162250 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 17:40:48.162339 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.162252 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 17:40:48.162552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.162526 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 17:40:48.162618 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.162561 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 17:40:48.162742 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.162693 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 17:40:48.162917 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.162794 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 17:40:48.162917 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.162825 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n9xj6\"" Jul 06 17:40:48.162917 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.162882 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 17:40:48.163103 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.163054 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 17:40:48.176431 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.176407 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:40:48.205336 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.205291 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.303825 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.303870 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.303899 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.303960 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.304014 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5zbt\" (UniqueName: \"kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-kube-api-access-f5zbt\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.304055 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.304116 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.304145 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-config-out\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.304169 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-web-config\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.304202 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.304228 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.304273 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-config-volume\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.305096 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.304302 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.339598 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.339563 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:48.396385 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.396219 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:48.405100 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405072 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-config-volume\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405100 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405101 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405299 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405137 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405299 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405161 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405299 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405184 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405299 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405214 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405299 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405242 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5zbt\" (UniqueName: \"kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-kube-api-access-f5zbt\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405299 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405281 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405557 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405321 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405557 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405343 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-config-out\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405557 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405362 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-web-config\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405557 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405393 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405557 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405419 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.405816 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.405772 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.406061 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.406028 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.406482 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:48.406431 2539 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 17:40:48.406577 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:48.406495 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-main-tls podName:66081887-4bcc-4851-bf9b-2bd634360241 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:48.906475498 +0000 UTC m=+119.137720655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "66081887-4bcc-4851-bf9b-2bd634360241") : secret "alertmanager-main-tls" not found Jul 06 17:40:48.407241 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:40:48.406797 2539 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-trusted-ca-bundle podName:66081887-4bcc-4851-bf9b-2bd634360241 nodeName:}" failed. No retries permitted until 2026-07-06 17:40:48.906781471 +0000 UTC m=+119.138026627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "66081887-4bcc-4851-bf9b-2bd634360241") : configmap references non-existent config key: ca-bundle.crt Jul 06 17:40:48.408542 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.408521 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.409034 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.408987 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-config-volume\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.410364 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.410339 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-config-out\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.410502 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.410476 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.410736 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.410689 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.410937 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.410917 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-web-config\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.411580 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.411545 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.412077 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.412054 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.416685 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.416663 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5zbt\" (UniqueName: \"kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-kube-api-access-f5zbt\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.757310 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.757283 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:48.843026 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.842990 2539 generic.go:356] "Generic (PLEG): container finished" podID="f16f4765-835f-4182-929a-7f979fc67cca" containerID="41910ff13e22e9003f78fd0367e08897c712b5c55151c3c6248620c23d809295" exitCode=0 Jul 06 17:40:48.843177 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.843082 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdd7z" event={"ID":"f16f4765-835f-4182-929a-7f979fc67cca","Type":"ContainerDied","Data":"41910ff13e22e9003f78fd0367e08897c712b5c55151c3c6248620c23d809295"} Jul 06 17:40:48.909388 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.909304 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.909520 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.909400 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.910267 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.910231 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:48.912144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:48.912120 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:49.071994 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:49.071946 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:40:49.295382 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:49.295254 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:40:49.305449 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:49.305410 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66081887_4bcc_4851_bf9b_2bd634360241.slice/crio-51bcc1a58ac818de500e11c3227b55202086d3fd1a1a2eaea04bf01dc7ba2efd WatchSource:0}: Error finding container 51bcc1a58ac818de500e11c3227b55202086d3fd1a1a2eaea04bf01dc7ba2efd: Status 404 returned error can't find the container with id 51bcc1a58ac818de500e11c3227b55202086d3fd1a1a2eaea04bf01dc7ba2efd Jul 06 17:40:49.849761 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:49.849722 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdd7z" event={"ID":"f16f4765-835f-4182-929a-7f979fc67cca","Type":"ContainerStarted","Data":"76cc5470921a4ec4289cdda456cf2dc72500d2c4c4551aaee8eed4bb9affb2cd"} Jul 06 17:40:49.849921 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:49.849788 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tdd7z" event={"ID":"f16f4765-835f-4182-929a-7f979fc67cca","Type":"ContainerStarted","Data":"8dca5445c197d04c339fa50f8894e762e23b91982133826039e2449862c795d6"} Jul 06 17:40:49.851021 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:49.850986 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerStarted","Data":"51bcc1a58ac818de500e11c3227b55202086d3fd1a1a2eaea04bf01dc7ba2efd"} Jul 06 17:40:49.853131 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:49.853105 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" event={"ID":"080c2129-ddd3-4dd4-88ab-eca13e82466a","Type":"ContainerStarted","Data":"8f2b67f2c5d88ccf51ced2f9b7679a7c50cdf0a28a905c4e5b1e68733d33f2d1"} Jul 06 17:40:49.853251 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:49.853158 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" event={"ID":"080c2129-ddd3-4dd4-88ab-eca13e82466a","Type":"ContainerStarted","Data":"d4cb6b90bebb082cb6dd8995e07b46f732298e9351d61272bc8416176cd9ee20"} Jul 06 17:40:49.853251 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:49.853187 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" event={"ID":"080c2129-ddd3-4dd4-88ab-eca13e82466a","Type":"ContainerStarted","Data":"4dc39337e50cc72ff7b1b39544a72ef19623f5ddf4011a0203aa39f8b8d951ab"} Jul 06 17:40:49.870330 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:49.870264 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tdd7z" podStartSLOduration=1.6380267480000001 podStartE2EDuration="2.870245744s" totalImagesPullingTime="1.160992633s" totalInitContainerRuntime="71.226363ms" isStatefulPod=true podCreationTimestamp="2026-07-06 17:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:49.86826777 +0000 UTC m=+120.099512946" watchObservedRunningTime="2026-07-06 17:40:49.870245744 +0000 UTC m=+120.101490919" Jul 06 17:40:49.886484 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:49.886429 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-fbqj9" podStartSLOduration=1.253463321 podStartE2EDuration="2.886409538s" totalImagesPullingTime="1.632946217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:49.885046776 +0000 UTC m=+120.116291963" watchObservedRunningTime="2026-07-06 17:40:49.886409538 +0000 UTC m=+120.117654715" Jul 06 17:40:50.020308 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:50.020278 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:50.118446 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:50.118323 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:50.242187 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:50.242149 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:50.857552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:50.857515 2539 generic.go:356] "Generic (PLEG): container finished" podID="66081887-4bcc-4851-bf9b-2bd634360241" containerID="dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef" exitCode=0 Jul 06 17:40:50.857977 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:50.857598 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerDied","Data":"dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef"} Jul 06 17:40:51.302661 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:51.302599 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:51.676381 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:51.676352 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:51.771843 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:51.771808 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:51.865199 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:51.865166 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:51.866056 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:51.866026 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6"] Jul 06 17:40:51.869381 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:51.869364 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" Jul 06 17:40:51.871911 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:51.871890 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 17:40:51.872047 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:51.872028 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hwsd4\"" Jul 06 17:40:51.877870 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:51.877847 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6"] Jul 06 17:40:51.956220 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:51.956123 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:52.034074 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.034015 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:52.039153 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.039102 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzhr6\" (UniqueName: \"kubernetes.io/projected/33fab8e8-99d4-48e5-a524-ffc419c108aa-kube-api-access-hzhr6\") pod \"monitoring-plugin-d5dcff7cf-5pxd6\" (UID: \"33fab8e8-99d4-48e5-a524-ffc419c108aa\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" Jul 06 17:40:52.039296 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.039237 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33fab8e8-99d4-48e5-a524-ffc419c108aa-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5pxd6\" (UID: \"33fab8e8-99d4-48e5-a524-ffc419c108aa\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" Jul 06 17:40:52.140264 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.140227 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzhr6\" (UniqueName: \"kubernetes.io/projected/33fab8e8-99d4-48e5-a524-ffc419c108aa-kube-api-access-hzhr6\") pod \"monitoring-plugin-d5dcff7cf-5pxd6\" (UID: \"33fab8e8-99d4-48e5-a524-ffc419c108aa\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" Jul 06 17:40:52.140423 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.140294 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33fab8e8-99d4-48e5-a524-ffc419c108aa-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5pxd6\" (UID: \"33fab8e8-99d4-48e5-a524-ffc419c108aa\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" Jul 06 17:40:52.142737 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.142714 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33fab8e8-99d4-48e5-a524-ffc419c108aa-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5pxd6\" (UID: \"33fab8e8-99d4-48e5-a524-ffc419c108aa\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" Jul 06 17:40:52.148123 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.148103 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzhr6\" (UniqueName: \"kubernetes.io/projected/33fab8e8-99d4-48e5-a524-ffc419c108aa-kube-api-access-hzhr6\") pod \"monitoring-plugin-d5dcff7cf-5pxd6\" (UID: \"33fab8e8-99d4-48e5-a524-ffc419c108aa\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" Jul 06 17:40:52.181031 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.181010 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" Jul 06 17:40:52.315467 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.315428 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6"] Jul 06 17:40:52.319580 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:52.319554 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33fab8e8_99d4_48e5_a524_ffc419c108aa.slice/crio-0ec9ee1accff5832273f9f6221d3382b51a7603d131fbeccf795383582434dc3 WatchSource:0}: Error finding container 0ec9ee1accff5832273f9f6221d3382b51a7603d131fbeccf795383582434dc3: Status 404 returned error can't find the container with id 0ec9ee1accff5832273f9f6221d3382b51a7603d131fbeccf795383582434dc3 Jul 06 17:40:52.363514 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.363450 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:52.437138 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.437087 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:52.754119 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.754086 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:52.854224 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.854184 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:52.866670 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.866645 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" event={"ID":"33fab8e8-99d4-48e5-a524-ffc419c108aa","Type":"ContainerStarted","Data":"0ec9ee1accff5832273f9f6221d3382b51a7603d131fbeccf795383582434dc3"} Jul 06 17:40:52.955926 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:52.955899 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:53.054648 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.054622 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:53.156301 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.156273 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:53.255447 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.255414 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:53.344574 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.344443 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:53.463867 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.463811 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:53.758488 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.758446 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:53.872966 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.872937 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerStarted","Data":"38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698"} Jul 06 17:40:53.873330 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.873022 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerStarted","Data":"8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2"} Jul 06 17:40:53.873330 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.873052 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerStarted","Data":"a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea"} Jul 06 17:40:53.873330 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.873076 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerStarted","Data":"7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708"} Jul 06 17:40:53.873330 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:53.873100 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerStarted","Data":"1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc"} Jul 06 17:40:54.570565 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:54.570482 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:54.670368 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:54.670331 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:54.878905 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:54.878806 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" event={"ID":"33fab8e8-99d4-48e5-a524-ffc419c108aa","Type":"ContainerStarted","Data":"a41568630b675eccaf228dbcbb5ac67760043413b54e233797ba2693df42a217"} Jul 06 17:40:54.879343 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:54.878974 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" Jul 06 17:40:54.882478 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:54.882452 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerStarted","Data":"06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5"} Jul 06 17:40:54.884560 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:54.884541 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" Jul 06 17:40:54.897894 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:54.897854 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5pxd6" podStartSLOduration=2.32256303 podStartE2EDuration="3.897839242s" totalImagesPullingTime="1.575276212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:54.89706298 +0000 UTC m=+125.128308157" watchObservedRunningTime="2026-07-06 17:40:54.897839242 +0000 UTC m=+125.129084452" Jul 06 17:40:54.939579 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:54.939508 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.832873751 podStartE2EDuration="6.939458025s" totalImagesPullingTime="4.09391256s" totalInitContainerRuntime="12.671714ms" isStatefulPod=false podCreationTimestamp="2026-07-06 17:40:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:40:54.937897947 +0000 UTC m=+125.169143136" watchObservedRunningTime="2026-07-06 17:40:54.939458025 +0000 UTC m=+125.170703201" Jul 06 17:40:56.665232 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:56.665206 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:40:57.357358 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:57.357324 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:57.458638 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:57.458604 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:40:59.106257 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:59.106193 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:40:59.108637 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:59.108613 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a31b714e-0b4b-4193-baf1-4473afd54463-metrics-certs\") pod \"network-metrics-daemon-dpd7c\" (UID: \"a31b714e-0b4b-4193-baf1-4473afd54463\") " pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:40:59.123387 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:59.123358 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wwzt2\"" Jul 06 17:40:59.131472 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:59.131448 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpd7c" Jul 06 17:40:59.262686 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:59.262651 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dpd7c"] Jul 06 17:40:59.265935 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:40:59.265905 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31b714e_0b4b_4193_baf1_4473afd54463.slice/crio-aca9f2b59983c45f291ab71ca79fafc9d0e1b85f42be89d96cb2a3b8542e75a7 WatchSource:0}: Error finding container aca9f2b59983c45f291ab71ca79fafc9d0e1b85f42be89d96cb2a3b8542e75a7: Status 404 returned error can't find the container with id aca9f2b59983c45f291ab71ca79fafc9d0e1b85f42be89d96cb2a3b8542e75a7 Jul 06 17:40:59.807526 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:59.807495 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78df6d6598-snpwv" Jul 06 17:40:59.902443 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:59.902405 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpd7c" event={"ID":"a31b714e-0b4b-4193-baf1-4473afd54463","Type":"ContainerStarted","Data":"aca9f2b59983c45f291ab71ca79fafc9d0e1b85f42be89d96cb2a3b8542e75a7"} Jul 06 17:40:59.944376 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:40:59.944343 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:00.043677 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:00.043639 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:00.911552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:00.911514 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpd7c" event={"ID":"a31b714e-0b4b-4193-baf1-4473afd54463","Type":"ContainerStarted","Data":"6f750ffcc67a0347162f803f12d77dc132d58f4641b8b77ae3cf9fb2d758ad25"} Jul 06 17:41:00.911960 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:00.911591 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpd7c" event={"ID":"a31b714e-0b4b-4193-baf1-4473afd54463","Type":"ContainerStarted","Data":"47e15fd1b55bf97eb8232787d98a66cd94164b822f1ce3761369fdc87797a09e"} Jul 06 17:41:00.928602 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:00.928548 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dpd7c" podStartSLOduration=130.050368458 podStartE2EDuration="2m10.928531896s" totalImagesPullingTime="878.163438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:41:00.927958341 +0000 UTC m=+131.159203518" watchObservedRunningTime="2026-07-06 17:41:00.928531896 +0000 UTC m=+131.159777072" Jul 06 17:41:01.029518 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:01.029481 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:01.086548 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:01.086517 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:01.681643 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:01.681583 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" podUID="a9018e0d-4d7d-40f6-b479-d895624c9258" containerName="registry" containerID="cri-o://f2c52add09271c03535fb56a5ae4c8d14ac60c36f31f0ea73eab11267eaec54a" gracePeriod=30 Jul 06 17:41:01.916863 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:01.916836 2539 generic.go:356] "Generic (PLEG): container finished" podID="a9018e0d-4d7d-40f6-b479-d895624c9258" containerID="f2c52add09271c03535fb56a5ae4c8d14ac60c36f31f0ea73eab11267eaec54a" exitCode=0 Jul 06 17:41:01.917186 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:01.916892 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" event={"ID":"a9018e0d-4d7d-40f6-b479-d895624c9258","Type":"ContainerDied","Data":"f2c52add09271c03535fb56a5ae4c8d14ac60c36f31f0ea73eab11267eaec54a"} Jul 06 17:41:01.929781 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:01.929762 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:41:02.030936 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.030838 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9018e0d-4d7d-40f6-b479-d895624c9258-ca-trust-extracted\") pod \"a9018e0d-4d7d-40f6-b479-d895624c9258\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " Jul 06 17:41:02.030936 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.030908 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-image-registry-private-configuration\") pod \"a9018e0d-4d7d-40f6-b479-d895624c9258\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " Jul 06 17:41:02.030936 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.030934 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-trusted-ca\") pod \"a9018e0d-4d7d-40f6-b479-d895624c9258\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " Jul 06 17:41:02.031258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.030974 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-bound-sa-token\") pod \"a9018e0d-4d7d-40f6-b479-d895624c9258\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " Jul 06 17:41:02.031258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.031006 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls\") pod \"a9018e0d-4d7d-40f6-b479-d895624c9258\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " Jul 06 17:41:02.031258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.031055 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbp9q\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-kube-api-access-qbp9q\") pod \"a9018e0d-4d7d-40f6-b479-d895624c9258\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " Jul 06 17:41:02.031258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.031083 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-installation-pull-secrets\") pod \"a9018e0d-4d7d-40f6-b479-d895624c9258\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " Jul 06 17:41:02.031258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.031119 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-certificates\") pod \"a9018e0d-4d7d-40f6-b479-d895624c9258\" (UID: \"a9018e0d-4d7d-40f6-b479-d895624c9258\") " Jul 06 17:41:02.031467 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.031387 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a9018e0d-4d7d-40f6-b479-d895624c9258" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:41:02.032076 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.032044 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a9018e0d-4d7d-40f6-b479-d895624c9258" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:41:02.033658 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.033620 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a9018e0d-4d7d-40f6-b479-d895624c9258" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:41:02.033658 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.033638 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a9018e0d-4d7d-40f6-b479-d895624c9258" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:41:02.033913 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.033883 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a9018e0d-4d7d-40f6-b479-d895624c9258" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:41:02.033913 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.033898 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a9018e0d-4d7d-40f6-b479-d895624c9258" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:41:02.034048 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.034021 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-kube-api-access-qbp9q" (OuterVolumeSpecName: "kube-api-access-qbp9q") pod "a9018e0d-4d7d-40f6-b479-d895624c9258" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258"). InnerVolumeSpecName "kube-api-access-qbp9q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:41:02.039935 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.039911 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9018e0d-4d7d-40f6-b479-d895624c9258-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a9018e0d-4d7d-40f6-b479-d895624c9258" (UID: "a9018e0d-4d7d-40f6-b479-d895624c9258"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:41:02.131772 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.131733 2539 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-bound-sa-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:02.131772 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.131762 2539 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-tls\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:02.131772 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.131771 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbp9q\" (UniqueName: \"kubernetes.io/projected/a9018e0d-4d7d-40f6-b479-d895624c9258-kube-api-access-qbp9q\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:02.131772 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.131780 2539 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-installation-pull-secrets\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:02.132049 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.131791 2539 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-registry-certificates\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:02.132049 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.131799 2539 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9018e0d-4d7d-40f6-b479-d895624c9258-ca-trust-extracted\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:02.132049 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.131808 2539 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9018e0d-4d7d-40f6-b479-d895624c9258-image-registry-private-configuration\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:02.132049 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.131816 2539 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9018e0d-4d7d-40f6-b479-d895624c9258-trusted-ca\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:02.921749 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.921692 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" event={"ID":"a9018e0d-4d7d-40f6-b479-d895624c9258","Type":"ContainerDied","Data":"247322f2537aa8f7477378fc1bc89fda70cc98dcd263c07c7d3b8b3b430ea351"} Jul 06 17:41:02.922164 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.921786 2539 scope.go:117] "RemoveContainer" containerID="f2c52add09271c03535fb56a5ae4c8d14ac60c36f31f0ea73eab11267eaec54a" Jul 06 17:41:02.922164 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.921730 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74d4db7868-x5xm7" Jul 06 17:41:02.939820 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.939794 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74d4db7868-x5xm7"] Jul 06 17:41:02.945516 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.945494 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74d4db7868-x5xm7"] Jul 06 17:41:02.984134 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.984100 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d74fbb654-mlhpn"] Jul 06 17:41:02.984374 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.984363 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9018e0d-4d7d-40f6-b479-d895624c9258" containerName="registry" Jul 06 17:41:02.984412 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.984376 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9018e0d-4d7d-40f6-b479-d895624c9258" containerName="registry" Jul 06 17:41:02.984452 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.984433 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9018e0d-4d7d-40f6-b479-d895624c9258" containerName="registry" Jul 06 17:41:02.991760 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.991736 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:02.994713 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.994637 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 17:41:02.994713 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.994680 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 17:41:02.994713 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.994637 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 17:41:02.995112 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.994718 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 17:41:02.995112 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.995013 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 17:41:02.995112 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.995046 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 17:41:02.995112 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.995099 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 17:41:02.995276 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:02.995171 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tqb76\"" Jul 06 17:41:03.001867 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.001846 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d74fbb654-mlhpn"] Jul 06 17:41:03.120312 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.120272 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:03.139239 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.139204 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-config\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.139367 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.139245 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqrrj\" (UniqueName: \"kubernetes.io/projected/d58aae38-b27d-4ed0-b962-e2211050d5ff-kube-api-access-zqrrj\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.139367 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.139309 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-oauth-config\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.139367 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.139355 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-serving-cert\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.139504 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.139385 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-oauth-serving-cert\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.139504 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.139457 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-service-ca\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.176082 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.176050 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:03.240215 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.240181 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-config\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.240391 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.240226 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqrrj\" (UniqueName: \"kubernetes.io/projected/d58aae38-b27d-4ed0-b962-e2211050d5ff-kube-api-access-zqrrj\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.240391 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.240263 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-oauth-config\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.240391 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.240300 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-serving-cert\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.240558 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.240429 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-oauth-serving-cert\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.240558 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.240494 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-service-ca\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.241126 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.241040 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-config\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.241126 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.241044 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-oauth-serving-cert\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.241426 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.241402 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-service-ca\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.242985 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.242957 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-oauth-config\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.243079 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.242961 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-serving-cert\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.249086 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.249065 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqrrj\" (UniqueName: \"kubernetes.io/projected/d58aae38-b27d-4ed0-b962-e2211050d5ff-kube-api-access-zqrrj\") pod \"console-d74fbb654-mlhpn\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.301022 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.300983 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:03.435926 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.435852 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d74fbb654-mlhpn"] Jul 06 17:41:03.438726 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:41:03.438680 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58aae38_b27d_4ed0_b962_e2211050d5ff.slice/crio-f0594eacad526815dcdd002cd63bd25080e655ed311f5d1172937c1fe5f8aa9c WatchSource:0}: Error finding container f0594eacad526815dcdd002cd63bd25080e655ed311f5d1172937c1fe5f8aa9c: Status 404 returned error can't find the container with id f0594eacad526815dcdd002cd63bd25080e655ed311f5d1172937c1fe5f8aa9c Jul 06 17:41:03.929851 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:03.929805 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d74fbb654-mlhpn" event={"ID":"d58aae38-b27d-4ed0-b962-e2211050d5ff","Type":"ContainerStarted","Data":"f0594eacad526815dcdd002cd63bd25080e655ed311f5d1172937c1fe5f8aa9c"} Jul 06 17:41:04.304053 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:04.303949 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9018e0d-4d7d-40f6-b479-d895624c9258" path="/var/lib/kubelet/pods/a9018e0d-4d7d-40f6-b479-d895624c9258/volumes" Jul 06 17:41:07.171959 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:07.171921 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:07.229667 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:07.229569 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:07.948135 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:07.948101 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d74fbb654-mlhpn" event={"ID":"d58aae38-b27d-4ed0-b962-e2211050d5ff","Type":"ContainerStarted","Data":"9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d"} Jul 06 17:41:07.968255 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:07.968204 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d74fbb654-mlhpn" podStartSLOduration=2.4598961360000002 podStartE2EDuration="5.968187584s" totalImagesPullingTime="3.508291448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:41:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:41:07.967587109 +0000 UTC m=+138.198832301" watchObservedRunningTime="2026-07-06 17:41:07.968187584 +0000 UTC m=+138.199432759" Jul 06 17:41:11.204979 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.204940 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:11.299368 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.299330 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:11.767508 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.767475 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9b5fcbfcb-rz28d"] Jul 06 17:41:11.777068 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.777046 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.781437 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.781378 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b5fcbfcb-rz28d"] Jul 06 17:41:11.785064 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.785039 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 17:41:11.807409 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.807375 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-oauth-serving-cert\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.807573 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.807418 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdvkm\" (UniqueName: \"kubernetes.io/projected/23f585e7-9dc8-4831-9067-254219551c2d-kube-api-access-gdvkm\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.807573 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.807436 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-service-ca\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.807573 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.807467 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-oauth-config\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.807573 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.807495 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-trusted-ca-bundle\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.807573 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.807529 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-console-config\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.807573 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.807560 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-serving-cert\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.908685 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.908654 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-oauth-serving-cert\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.908861 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.908731 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdvkm\" (UniqueName: \"kubernetes.io/projected/23f585e7-9dc8-4831-9067-254219551c2d-kube-api-access-gdvkm\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.908861 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.908763 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-service-ca\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.908861 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.908791 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-oauth-config\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.908977 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.908933 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-trusted-ca-bundle\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.909026 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.908995 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-console-config\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.909075 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.909053 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-serving-cert\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.909496 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.909472 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-oauth-serving-cert\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.909734 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.909684 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-console-config\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.909938 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.909916 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-service-ca\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.910057 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.910040 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-trusted-ca-bundle\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.911234 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.911211 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-oauth-config\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.911456 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.911441 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-serving-cert\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:11.917021 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:11.916996 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdvkm\" (UniqueName: \"kubernetes.io/projected/23f585e7-9dc8-4831-9067-254219551c2d-kube-api-access-gdvkm\") pod \"console-9b5fcbfcb-rz28d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:12.087681 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:12.087567 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:12.219961 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:12.219929 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b5fcbfcb-rz28d"] Jul 06 17:41:12.223103 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:41:12.223068 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f585e7_9dc8_4831_9067_254219551c2d.slice/crio-19eaae3d3b97d222991e64519faf33d1523030d00aaf4fd5c537b20e92e3c713 WatchSource:0}: Error finding container 19eaae3d3b97d222991e64519faf33d1523030d00aaf4fd5c537b20e92e3c713: Status 404 returned error can't find the container with id 19eaae3d3b97d222991e64519faf33d1523030d00aaf4fd5c537b20e92e3c713 Jul 06 17:41:12.967615 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:12.967582 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b5fcbfcb-rz28d" event={"ID":"23f585e7-9dc8-4831-9067-254219551c2d","Type":"ContainerStarted","Data":"edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226"} Jul 06 17:41:12.967780 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:12.967631 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b5fcbfcb-rz28d" event={"ID":"23f585e7-9dc8-4831-9067-254219551c2d","Type":"ContainerStarted","Data":"19eaae3d3b97d222991e64519faf33d1523030d00aaf4fd5c537b20e92e3c713"} Jul 06 17:41:12.985569 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:12.985517 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9b5fcbfcb-rz28d" podStartSLOduration=1.9854997220000001 podStartE2EDuration="1.985499722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:41:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:41:12.984923768 +0000 UTC m=+143.216168945" watchObservedRunningTime="2026-07-06 17:41:12.985499722 +0000 UTC m=+143.216744906" Jul 06 17:41:13.302222 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:13.302136 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:13.302222 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:13.302200 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:13.306985 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:13.306963 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:13.975010 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:13.974980 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:14.582534 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:14.582502 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:15.777716 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:15.777669 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:15.833825 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:15.833794 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:16.095352 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:16.095238 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:16.196611 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:16.196575 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:20.174731 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:20.174682 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:20.226406 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:20.226371 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:22.088744 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:22.088682 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:22.089253 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:22.088779 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:22.093432 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:22.093409 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:22.881624 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:22.881580 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:22.982000 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:22.981967 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:23.007536 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:23.007509 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:41:23.054898 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:23.054858 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d74fbb654-mlhpn"] Jul 06 17:41:23.060494 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:23.060459 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:23.162720 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:23.162610 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:23.266505 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:23.266463 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:23.364904 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:23.364866 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:31.082953 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:31.082912 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:31.184197 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:31.184161 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:34.709108 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:34.709077 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:34.767496 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:34.767465 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:35.015436 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:35.015341 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:35.091508 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:35.091479 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:43.735762 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:43.735661 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:43.803288 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:43.803256 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:48.076816 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.076750 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d74fbb654-mlhpn" podUID="d58aae38-b27d-4ed0-b962-e2211050d5ff" containerName="console" containerID="cri-o://9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d" gracePeriod=15 Jul 06 17:41:48.315375 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.315355 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:48.427677 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.427648 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-config\") pod \"d58aae38-b27d-4ed0-b962-e2211050d5ff\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " Jul 06 17:41:48.427878 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.427684 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-oauth-config\") pod \"d58aae38-b27d-4ed0-b962-e2211050d5ff\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " Jul 06 17:41:48.427878 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.427731 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-serving-cert\") pod \"d58aae38-b27d-4ed0-b962-e2211050d5ff\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " Jul 06 17:41:48.427878 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.427772 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqrrj\" (UniqueName: \"kubernetes.io/projected/d58aae38-b27d-4ed0-b962-e2211050d5ff-kube-api-access-zqrrj\") pod \"d58aae38-b27d-4ed0-b962-e2211050d5ff\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " Jul 06 17:41:48.427878 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.427808 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-oauth-serving-cert\") pod \"d58aae38-b27d-4ed0-b962-e2211050d5ff\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " Jul 06 17:41:48.427878 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.427831 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-service-ca\") pod \"d58aae38-b27d-4ed0-b962-e2211050d5ff\" (UID: \"d58aae38-b27d-4ed0-b962-e2211050d5ff\") " Jul 06 17:41:48.428256 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.428222 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-config" (OuterVolumeSpecName: "console-config") pod "d58aae38-b27d-4ed0-b962-e2211050d5ff" (UID: "d58aae38-b27d-4ed0-b962-e2211050d5ff"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:41:48.428369 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.428330 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d58aae38-b27d-4ed0-b962-e2211050d5ff" (UID: "d58aae38-b27d-4ed0-b962-e2211050d5ff"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:41:48.428648 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.428620 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-service-ca" (OuterVolumeSpecName: "service-ca") pod "d58aae38-b27d-4ed0-b962-e2211050d5ff" (UID: "d58aae38-b27d-4ed0-b962-e2211050d5ff"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:41:48.430204 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.430171 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d58aae38-b27d-4ed0-b962-e2211050d5ff" (UID: "d58aae38-b27d-4ed0-b962-e2211050d5ff"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:41:48.430589 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.430570 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d58aae38-b27d-4ed0-b962-e2211050d5ff" (UID: "d58aae38-b27d-4ed0-b962-e2211050d5ff"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:41:48.430685 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.430586 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d58aae38-b27d-4ed0-b962-e2211050d5ff-kube-api-access-zqrrj" (OuterVolumeSpecName: "kube-api-access-zqrrj") pod "d58aae38-b27d-4ed0-b962-e2211050d5ff" (UID: "d58aae38-b27d-4ed0-b962-e2211050d5ff"). InnerVolumeSpecName "kube-api-access-zqrrj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:41:48.529192 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.529151 2539 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-oauth-serving-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:48.529192 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.529184 2539 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-service-ca\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:48.529192 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.529194 2539 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:48.529192 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.529205 2539 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-oauth-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:48.529476 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.529225 2539 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d58aae38-b27d-4ed0-b962-e2211050d5ff-console-serving-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:48.529476 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:48.529235 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqrrj\" (UniqueName: \"kubernetes.io/projected/d58aae38-b27d-4ed0-b962-e2211050d5ff-kube-api-access-zqrrj\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:41:49.096918 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:49.096887 2539 generic.go:356] "Generic (PLEG): container finished" podID="d58aae38-b27d-4ed0-b962-e2211050d5ff" containerID="9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d" exitCode=0 Jul 06 17:41:49.097316 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:49.096929 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d74fbb654-mlhpn" Jul 06 17:41:49.097316 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:49.096971 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d74fbb654-mlhpn" event={"ID":"d58aae38-b27d-4ed0-b962-e2211050d5ff","Type":"ContainerDied","Data":"9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d"} Jul 06 17:41:49.097316 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:49.097020 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d74fbb654-mlhpn" event={"ID":"d58aae38-b27d-4ed0-b962-e2211050d5ff","Type":"ContainerDied","Data":"f0594eacad526815dcdd002cd63bd25080e655ed311f5d1172937c1fe5f8aa9c"} Jul 06 17:41:49.097316 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:49.097041 2539 scope.go:117] "RemoveContainer" containerID="9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d" Jul 06 17:41:49.105832 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:49.105804 2539 scope.go:117] "RemoveContainer" containerID="9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d" Jul 06 17:41:49.106130 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:41:49.106111 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d\": container with ID starting with 9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d not found: ID does not exist" containerID="9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d" Jul 06 17:41:49.106188 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:49.106140 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d"} err="failed to get container status \"9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d\": rpc error: code = NotFound desc = could not find container \"9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d\": container with ID starting with 9d3a4a4690ee54d3a20ad47f445cab90049fc6851b99b8fcdb14eccee66f271d not found: ID does not exist" Jul 06 17:41:49.118921 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:49.118896 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d74fbb654-mlhpn"] Jul 06 17:41:49.122183 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:49.122159 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d74fbb654-mlhpn"] Jul 06 17:41:50.304301 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:50.304266 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d58aae38-b27d-4ed0-b962-e2211050d5ff" path="/var/lib/kubelet/pods/d58aae38-b27d-4ed0-b962-e2211050d5ff/volumes" Jul 06 17:41:57.190322 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:57.190278 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:41:57.250575 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:41:57.250539 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:03.147520 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:03.147454 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:03.210019 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:03.209983 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:07.384012 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:07.383974 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:42:07.384450 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:07.384246 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="alertmanager" containerID="cri-o://1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc" gracePeriod=120 Jul 06 17:42:07.384450 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:07.384332 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy-metric" containerID="cri-o://38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698" gracePeriod=120 Jul 06 17:42:07.384450 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:07.384341 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="prom-label-proxy" containerID="cri-o://06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5" gracePeriod=120 Jul 06 17:42:07.384450 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:07.384375 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy-web" containerID="cri-o://a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea" gracePeriod=120 Jul 06 17:42:07.384450 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:07.384414 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="config-reloader" containerID="cri-o://7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708" gracePeriod=120 Jul 06 17:42:07.384680 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:07.384414 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy" containerID="cri-o://8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2" gracePeriod=120 Jul 06 17:42:08.169280 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.169245 2539 generic.go:356] "Generic (PLEG): container finished" podID="66081887-4bcc-4851-bf9b-2bd634360241" containerID="06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5" exitCode=0 Jul 06 17:42:08.169280 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.169269 2539 generic.go:356] "Generic (PLEG): container finished" podID="66081887-4bcc-4851-bf9b-2bd634360241" containerID="38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698" exitCode=0 Jul 06 17:42:08.169280 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.169275 2539 generic.go:356] "Generic (PLEG): container finished" podID="66081887-4bcc-4851-bf9b-2bd634360241" containerID="8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2" exitCode=0 Jul 06 17:42:08.169280 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.169281 2539 generic.go:356] "Generic (PLEG): container finished" podID="66081887-4bcc-4851-bf9b-2bd634360241" containerID="7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708" exitCode=0 Jul 06 17:42:08.169280 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.169287 2539 generic.go:356] "Generic (PLEG): container finished" podID="66081887-4bcc-4851-bf9b-2bd634360241" containerID="1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc" exitCode=0 Jul 06 17:42:08.169561 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.169315 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerDied","Data":"06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5"} Jul 06 17:42:08.169561 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.169396 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerDied","Data":"38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698"} Jul 06 17:42:08.169561 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.169421 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerDied","Data":"8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2"} Jul 06 17:42:08.169561 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.169446 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerDied","Data":"7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708"} Jul 06 17:42:08.169561 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.169471 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerDied","Data":"1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc"} Jul 06 17:42:08.632775 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.631508 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:08.672715 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.672676 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-tls-assets\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.672894 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.672734 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-web-config\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.672894 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.672756 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-main-db\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.672894 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.672801 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-trusted-ca-bundle\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.672894 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.672836 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-main-tls\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.672894 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.672874 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-config-out\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.673212 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.672913 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-metric\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.673212 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.672941 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-cluster-tls-config\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.673212 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.672972 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-config-volume\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.673212 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.673025 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-web\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.673212 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.673059 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-metrics-client-ca\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.673212 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.673104 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.673212 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.673129 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5zbt\" (UniqueName: \"kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-kube-api-access-f5zbt\") pod \"66081887-4bcc-4851-bf9b-2bd634360241\" (UID: \"66081887-4bcc-4851-bf9b-2bd634360241\") " Jul 06 17:42:08.673212 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.673151 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:42:08.673597 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.673496 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:42:08.673597 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.673507 2539 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-main-db\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.675722 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.675647 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:42:08.677916 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.677876 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:42:08.678005 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.677914 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:42:08.678061 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.678003 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-config-out" (OuterVolumeSpecName: "config-out") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:42:08.678353 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.678328 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:42:08.678561 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.678526 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-config-volume" (OuterVolumeSpecName: "config-volume") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:42:08.678650 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.678635 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-kube-api-access-f5zbt" (OuterVolumeSpecName: "kube-api-access-f5zbt") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "kube-api-access-f5zbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:42:08.678918 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.678881 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:42:08.680558 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.680524 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:42:08.682206 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.682173 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:42:08.687923 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.687900 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-web-config" (OuterVolumeSpecName: "web-config") pod "66081887-4bcc-4851-bf9b-2bd634360241" (UID: "66081887-4bcc-4851-bf9b-2bd634360241"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:42:08.774499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774414 2539 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66081887-4bcc-4851-bf9b-2bd634360241-config-out\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774443 2539 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774454 2539 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-cluster-tls-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774463 2539 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-config-volume\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774472 2539 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774481 2539 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-metrics-client-ca\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774489 2539 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774497 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5zbt\" (UniqueName: \"kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-kube-api-access-f5zbt\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774506 2539 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66081887-4bcc-4851-bf9b-2bd634360241-tls-assets\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774904 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774514 2539 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-web-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774904 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774522 2539 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66081887-4bcc-4851-bf9b-2bd634360241-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.774904 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.774531 2539 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66081887-4bcc-4851-bf9b-2bd634360241-secret-alertmanager-main-tls\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:08.795258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795221 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68dd8c8d97-zkgkp"] Jul 06 17:42:08.795508 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795495 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="prom-label-proxy" Jul 06 17:42:08.795550 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795510 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="prom-label-proxy" Jul 06 17:42:08.795550 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795521 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy-metric" Jul 06 17:42:08.795550 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795526 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy-metric" Jul 06 17:42:08.795550 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795537 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d58aae38-b27d-4ed0-b962-e2211050d5ff" containerName="console" Jul 06 17:42:08.795550 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795542 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="d58aae38-b27d-4ed0-b962-e2211050d5ff" containerName="console" Jul 06 17:42:08.795550 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795550 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="config-reloader" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795555 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="config-reloader" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795565 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="alertmanager" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795570 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="alertmanager" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795575 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy-web" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795580 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy-web" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795587 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="init-config-reloader" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795592 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="init-config-reloader" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795597 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795601 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795639 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795645 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="alertmanager" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795651 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="config-reloader" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795656 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy-metric" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795661 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="d58aae38-b27d-4ed0-b962-e2211050d5ff" containerName="console" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795668 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="kube-rbac-proxy-web" Jul 06 17:42:08.795771 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.795674 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="66081887-4bcc-4851-bf9b-2bd634360241" containerName="prom-label-proxy" Jul 06 17:42:08.798347 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.798329 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.812165 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.812141 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68dd8c8d97-zkgkp"] Jul 06 17:42:08.848501 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.848462 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:08.875239 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.875207 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-console-config\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.875239 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.875243 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-service-ca\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.875433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.875261 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-trusted-ca-bundle\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.875433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.875287 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-oauth-config\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.875433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.875350 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-oauth-serving-cert\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.875433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.875400 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjlnc\" (UniqueName: \"kubernetes.io/projected/cbd4ffbd-d51c-402b-ac68-93970e118582-kube-api-access-wjlnc\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.875576 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.875438 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-serving-cert\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.949626 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.949594 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:08.976342 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.976310 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-serving-cert\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.976476 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.976359 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-console-config\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.976476 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.976377 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-service-ca\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.976476 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.976395 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-trusted-ca-bundle\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.976636 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.976576 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-oauth-config\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.976689 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.976648 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-oauth-serving-cert\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.976768 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.976720 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjlnc\" (UniqueName: \"kubernetes.io/projected/cbd4ffbd-d51c-402b-ac68-93970e118582-kube-api-access-wjlnc\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.977162 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.977117 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-console-config\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.977162 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.977138 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-service-ca\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.977433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.977274 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-trusted-ca-bundle\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.977433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.977305 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-oauth-serving-cert\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.979724 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.979671 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-oauth-config\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.979802 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.979678 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-serving-cert\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:08.985539 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:08.985521 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjlnc\" (UniqueName: \"kubernetes.io/projected/cbd4ffbd-d51c-402b-ac68-93970e118582-kube-api-access-wjlnc\") pod \"console-68dd8c8d97-zkgkp\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:09.107766 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.107662 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:09.177279 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.177252 2539 generic.go:356] "Generic (PLEG): container finished" podID="66081887-4bcc-4851-bf9b-2bd634360241" containerID="a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea" exitCode=0 Jul 06 17:42:09.177427 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.177342 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.177427 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.177336 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerDied","Data":"a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea"} Jul 06 17:42:09.177492 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.177477 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66081887-4bcc-4851-bf9b-2bd634360241","Type":"ContainerDied","Data":"51bcc1a58ac818de500e11c3227b55202086d3fd1a1a2eaea04bf01dc7ba2efd"} Jul 06 17:42:09.177528 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.177515 2539 scope.go:117] "RemoveContainer" containerID="06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5" Jul 06 17:42:09.185419 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.185344 2539 scope.go:117] "RemoveContainer" containerID="38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698" Jul 06 17:42:09.194689 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.194667 2539 scope.go:117] "RemoveContainer" containerID="8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2" Jul 06 17:42:09.202861 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.202736 2539 scope.go:117] "RemoveContainer" containerID="a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea" Jul 06 17:42:09.203264 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.203241 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:42:09.208112 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.207979 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:42:09.211130 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.211115 2539 scope.go:117] "RemoveContainer" containerID="7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708" Jul 06 17:42:09.219351 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.219334 2539 scope.go:117] "RemoveContainer" containerID="1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc" Jul 06 17:42:09.226789 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.226772 2539 scope.go:117] "RemoveContainer" containerID="dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef" Jul 06 17:42:09.233114 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.233094 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:42:09.235028 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.235005 2539 scope.go:117] "RemoveContainer" containerID="06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5" Jul 06 17:42:09.235287 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:42:09.235268 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5\": container with ID starting with 06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5 not found: ID does not exist" containerID="06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5" Jul 06 17:42:09.235362 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.235311 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5"} err="failed to get container status \"06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5\": rpc error: code = NotFound desc = could not find container \"06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5\": container with ID starting with 06d082cabfb6f7c7b7ed96521b83b1e84dec3765c0578980a6800620cece36c5 not found: ID does not exist" Jul 06 17:42:09.235362 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.235335 2539 scope.go:117] "RemoveContainer" containerID="38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698" Jul 06 17:42:09.235568 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:42:09.235551 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698\": container with ID starting with 38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698 not found: ID does not exist" containerID="38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698" Jul 06 17:42:09.235604 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.235575 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698"} err="failed to get container status \"38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698\": rpc error: code = NotFound desc = could not find container \"38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698\": container with ID starting with 38481cecd315c08d20de11ca771a512df43365f1e92bd7b308840de3378be698 not found: ID does not exist" Jul 06 17:42:09.235604 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.235590 2539 scope.go:117] "RemoveContainer" containerID="8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2" Jul 06 17:42:09.235862 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:42:09.235845 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2\": container with ID starting with 8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2 not found: ID does not exist" containerID="8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2" Jul 06 17:42:09.235955 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.235887 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2"} err="failed to get container status \"8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2\": rpc error: code = NotFound desc = could not find container \"8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2\": container with ID starting with 8ef4a4e93a23bb8f3b526324ea02e6589d5cd66d5538b8e0a6ef2a1d9feeb2c2 not found: ID does not exist" Jul 06 17:42:09.235955 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.235907 2539 scope.go:117] "RemoveContainer" containerID="a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea" Jul 06 17:42:09.236501 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:42:09.236478 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea\": container with ID starting with a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea not found: ID does not exist" containerID="a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea" Jul 06 17:42:09.236540 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.236510 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea"} err="failed to get container status \"a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea\": rpc error: code = NotFound desc = could not find container \"a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea\": container with ID starting with a1e892f41e6df28c6124c40401bb8f9ac4309551576eaf86c0e1949dccbcb8ea not found: ID does not exist" Jul 06 17:42:09.236540 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.236530 2539 scope.go:117] "RemoveContainer" containerID="7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708" Jul 06 17:42:09.236733 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.236691 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.236843 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:42:09.236821 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708\": container with ID starting with 7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708 not found: ID does not exist" containerID="7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708" Jul 06 17:42:09.236888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.236851 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708"} err="failed to get container status \"7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708\": rpc error: code = NotFound desc = could not find container \"7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708\": container with ID starting with 7bde08c2d6299c0cf1e713ca1909df29a85ba2aec15c8030bd360a428d30a708 not found: ID does not exist" Jul 06 17:42:09.236888 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.236870 2539 scope.go:117] "RemoveContainer" containerID="1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc" Jul 06 17:42:09.237357 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:42:09.237282 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc\": container with ID starting with 1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc not found: ID does not exist" containerID="1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc" Jul 06 17:42:09.237357 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.237312 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc"} err="failed to get container status \"1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc\": rpc error: code = NotFound desc = could not find container \"1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc\": container with ID starting with 1a2a5c25f00fcec0d53cbfd740889741d251effaf064caa6f98c848e5ac721bc not found: ID does not exist" Jul 06 17:42:09.237357 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.237332 2539 scope.go:117] "RemoveContainer" containerID="dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef" Jul 06 17:42:09.237635 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:42:09.237616 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef\": container with ID starting with dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef not found: ID does not exist" containerID="dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef" Jul 06 17:42:09.237688 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.237640 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef"} err="failed to get container status \"dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef\": rpc error: code = NotFound desc = could not find container \"dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef\": container with ID starting with dad1eac468a2dccf611202f0a53daa75acd6cbe13ecdd3a40e3f9ced14bb79ef not found: ID does not exist" Jul 06 17:42:09.239836 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.239543 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 17:42:09.239836 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.239543 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 17:42:09.240060 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.239846 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 17:42:09.240256 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.240236 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n9xj6\"" Jul 06 17:42:09.240450 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.240372 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 17:42:09.240527 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.240492 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 17:42:09.240580 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.240236 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 17:42:09.240636 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.240579 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 17:42:09.240837 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.240818 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 17:42:09.242221 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.242203 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68dd8c8d97-zkgkp"] Jul 06 17:42:09.245167 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.245079 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 17:42:09.245833 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:42:09.245809 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd4ffbd_d51c_402b_ac68_93970e118582.slice/crio-31751d6b6ff63ef56f81faf652bcbbdbfbb0093924aa7b7499500c6a540163ad WatchSource:0}: Error finding container 31751d6b6ff63ef56f81faf652bcbbdbfbb0093924aa7b7499500c6a540163ad: Status 404 returned error can't find the container with id 31751d6b6ff63ef56f81faf652bcbbdbfbb0093924aa7b7499500c6a540163ad Jul 06 17:42:09.251548 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.251532 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:42:09.278161 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278137 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/209c366c-bdae-4dce-b999-a244d8328769-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278275 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278171 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/209c366c-bdae-4dce-b999-a244d8328769-tls-assets\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278275 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278190 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-config-volume\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278275 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278249 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-487nx\" (UniqueName: \"kubernetes.io/projected/209c366c-bdae-4dce-b999-a244d8328769-kube-api-access-487nx\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278369 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278289 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278369 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278322 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278429 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278369 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/209c366c-bdae-4dce-b999-a244d8328769-config-out\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278429 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278400 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278497 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278453 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278497 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278479 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-web-config\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278570 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278507 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/209c366c-bdae-4dce-b999-a244d8328769-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278570 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278538 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209c366c-bdae-4dce-b999-a244d8328769-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.278570 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.278565 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379554 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379465 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-web-config\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379554 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379505 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/209c366c-bdae-4dce-b999-a244d8328769-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379554 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379528 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209c366c-bdae-4dce-b999-a244d8328769-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379554 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379546 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379932 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379561 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/209c366c-bdae-4dce-b999-a244d8328769-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379932 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379579 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/209c366c-bdae-4dce-b999-a244d8328769-tls-assets\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379932 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379603 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-config-volume\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379932 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379626 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-487nx\" (UniqueName: \"kubernetes.io/projected/209c366c-bdae-4dce-b999-a244d8328769-kube-api-access-487nx\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379932 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379651 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379932 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379678 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379932 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379734 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/209c366c-bdae-4dce-b999-a244d8328769-config-out\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379932 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379773 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.379932 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.379835 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.380374 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.380064 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/209c366c-bdae-4dce-b999-a244d8328769-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.380451 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.380424 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/209c366c-bdae-4dce-b999-a244d8328769-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.380581 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.380558 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/209c366c-bdae-4dce-b999-a244d8328769-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.383000 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.382962 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/209c366c-bdae-4dce-b999-a244d8328769-config-out\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.383284 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.383269 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-config-volume\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.383342 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.383278 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.383342 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.383313 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.383429 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.383338 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.383640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.383626 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/209c366c-bdae-4dce-b999-a244d8328769-tls-assets\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.383741 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.383720 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-web-config\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.384408 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.384391 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.384868 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.384851 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/209c366c-bdae-4dce-b999-a244d8328769-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.388236 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.388211 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-487nx\" (UniqueName: \"kubernetes.io/projected/209c366c-bdae-4dce-b999-a244d8328769-kube-api-access-487nx\") pod \"alertmanager-main-0\" (UID: \"209c366c-bdae-4dce-b999-a244d8328769\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.548264 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.548226 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 17:42:09.686070 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:09.686010 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 17:42:09.688491 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:42:09.688462 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209c366c_bdae_4dce_b999_a244d8328769.slice/crio-539ad6d86ee1018c43448cd0a85d628549a3839e0f843ed39e6a9331c610dcb0 WatchSource:0}: Error finding container 539ad6d86ee1018c43448cd0a85d628549a3839e0f843ed39e6a9331c610dcb0: Status 404 returned error can't find the container with id 539ad6d86ee1018c43448cd0a85d628549a3839e0f843ed39e6a9331c610dcb0 Jul 06 17:42:10.185547 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:10.185507 2539 generic.go:356] "Generic (PLEG): container finished" podID="209c366c-bdae-4dce-b999-a244d8328769" containerID="635c24ba362f939b657d4e0bcf7dc11c95d9550cac42322f282da0e491cbcd86" exitCode=0 Jul 06 17:42:10.185728 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:10.185563 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"209c366c-bdae-4dce-b999-a244d8328769","Type":"ContainerDied","Data":"635c24ba362f939b657d4e0bcf7dc11c95d9550cac42322f282da0e491cbcd86"} Jul 06 17:42:10.185728 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:10.185633 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"209c366c-bdae-4dce-b999-a244d8328769","Type":"ContainerStarted","Data":"539ad6d86ee1018c43448cd0a85d628549a3839e0f843ed39e6a9331c610dcb0"} Jul 06 17:42:10.187587 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:10.187562 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dd8c8d97-zkgkp" event={"ID":"cbd4ffbd-d51c-402b-ac68-93970e118582","Type":"ContainerStarted","Data":"197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df"} Jul 06 17:42:10.187737 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:10.187607 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dd8c8d97-zkgkp" event={"ID":"cbd4ffbd-d51c-402b-ac68-93970e118582","Type":"ContainerStarted","Data":"31751d6b6ff63ef56f81faf652bcbbdbfbb0093924aa7b7499500c6a540163ad"} Jul 06 17:42:10.228901 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:10.228857 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68dd8c8d97-zkgkp" podStartSLOduration=2.228839286 podStartE2EDuration="2.228839286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:42:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:42:10.228296915 +0000 UTC m=+200.459542092" watchObservedRunningTime="2026-07-06 17:42:10.228839286 +0000 UTC m=+200.460084456" Jul 06 17:42:10.303838 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:10.303806 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66081887-4bcc-4851-bf9b-2bd634360241" path="/var/lib/kubelet/pods/66081887-4bcc-4851-bf9b-2bd634360241/volumes" Jul 06 17:42:11.195543 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:11.195501 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"209c366c-bdae-4dce-b999-a244d8328769","Type":"ContainerStarted","Data":"072a535ac9a0b28ef865617cc73cd7c3cde9fee4b4690f0062ae903251e4b26f"} Jul 06 17:42:11.196008 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:11.195570 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"209c366c-bdae-4dce-b999-a244d8328769","Type":"ContainerStarted","Data":"1db8d3f11bf89e4ac8608c77c435bd21f6c1f715a86333b0b3383b8973469930"} Jul 06 17:42:11.196008 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:11.195603 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"209c366c-bdae-4dce-b999-a244d8328769","Type":"ContainerStarted","Data":"221c6329e8041bc9a0e808eec9d0ffddb08c9748d59857184e7d720ec57e8c0e"} Jul 06 17:42:11.196008 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:11.195629 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"209c366c-bdae-4dce-b999-a244d8328769","Type":"ContainerStarted","Data":"575b7b328c2cef1aa1cc72987d353e45015ed7bece440f2f5c65827336a82b4b"} Jul 06 17:42:11.196008 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:11.195652 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"209c366c-bdae-4dce-b999-a244d8328769","Type":"ContainerStarted","Data":"5f7fe06578360442d43f89a9785a0ed4f462489c83ca6608b936a4e074b44283"} Jul 06 17:42:11.196008 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:11.195674 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"209c366c-bdae-4dce-b999-a244d8328769","Type":"ContainerStarted","Data":"13ec913b7dd5495c9c48df5fa47341dfa96cfb405eabc073b7a748717a4caabb"} Jul 06 17:42:11.222671 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:11.222624 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.205548633 podStartE2EDuration="2.222607748s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.059115ms" isStatefulPod=false podCreationTimestamp="2026-07-06 17:42:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:42:11.220967738 +0000 UTC m=+201.452212914" watchObservedRunningTime="2026-07-06 17:42:11.222607748 +0000 UTC m=+201.453852922" Jul 06 17:42:14.996770 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:14.996733 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:15.054751 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:15.054719 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:19.107989 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:19.107960 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:19.108411 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:19.108250 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:19.112866 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:19.112842 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:19.230118 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:19.230083 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:42:19.277624 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:19.277591 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b5fcbfcb-rz28d"] Jul 06 17:42:19.385117 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:19.385026 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:19.437996 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:19.437963 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:19.493226 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:19.493187 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:31.101332 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:31.101291 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:31.201960 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:31.201899 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:42:44.301848 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.301798 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9b5fcbfcb-rz28d" podUID="23f585e7-9dc8-4831-9067-254219551c2d" containerName="console" containerID="cri-o://edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226" gracePeriod=15 Jul 06 17:42:44.546854 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.546830 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:42:44.686626 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.686596 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-serving-cert\") pod \"23f585e7-9dc8-4831-9067-254219551c2d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " Jul 06 17:42:44.686824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.686660 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdvkm\" (UniqueName: \"kubernetes.io/projected/23f585e7-9dc8-4831-9067-254219551c2d-kube-api-access-gdvkm\") pod \"23f585e7-9dc8-4831-9067-254219551c2d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " Jul 06 17:42:44.686824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.686680 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-oauth-config\") pod \"23f585e7-9dc8-4831-9067-254219551c2d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " Jul 06 17:42:44.686824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.686734 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-oauth-serving-cert\") pod \"23f585e7-9dc8-4831-9067-254219551c2d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " Jul 06 17:42:44.686824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.686765 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-service-ca\") pod \"23f585e7-9dc8-4831-9067-254219551c2d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " Jul 06 17:42:44.686824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.686805 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-console-config\") pod \"23f585e7-9dc8-4831-9067-254219551c2d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " Jul 06 17:42:44.686824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.686827 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-trusted-ca-bundle\") pod \"23f585e7-9dc8-4831-9067-254219551c2d\" (UID: \"23f585e7-9dc8-4831-9067-254219551c2d\") " Jul 06 17:42:44.687287 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.687234 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-console-config" (OuterVolumeSpecName: "console-config") pod "23f585e7-9dc8-4831-9067-254219551c2d" (UID: "23f585e7-9dc8-4831-9067-254219551c2d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:42:44.687287 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.687249 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-service-ca" (OuterVolumeSpecName: "service-ca") pod "23f585e7-9dc8-4831-9067-254219551c2d" (UID: "23f585e7-9dc8-4831-9067-254219551c2d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:42:44.687287 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.687236 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "23f585e7-9dc8-4831-9067-254219551c2d" (UID: "23f585e7-9dc8-4831-9067-254219551c2d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:42:44.687287 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.687266 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "23f585e7-9dc8-4831-9067-254219551c2d" (UID: "23f585e7-9dc8-4831-9067-254219551c2d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:42:44.687500 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.687384 2539 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-console-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:44.687500 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.687397 2539 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-trusted-ca-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:44.687500 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.687405 2539 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-oauth-serving-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:44.687500 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.687413 2539 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/23f585e7-9dc8-4831-9067-254219551c2d-service-ca\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:44.689017 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.688976 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "23f585e7-9dc8-4831-9067-254219551c2d" (UID: "23f585e7-9dc8-4831-9067-254219551c2d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:42:44.689370 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.689345 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "23f585e7-9dc8-4831-9067-254219551c2d" (UID: "23f585e7-9dc8-4831-9067-254219551c2d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:42:44.689444 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.689377 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23f585e7-9dc8-4831-9067-254219551c2d-kube-api-access-gdvkm" (OuterVolumeSpecName: "kube-api-access-gdvkm") pod "23f585e7-9dc8-4831-9067-254219551c2d" (UID: "23f585e7-9dc8-4831-9067-254219551c2d"). InnerVolumeSpecName "kube-api-access-gdvkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:42:44.788803 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.788766 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdvkm\" (UniqueName: \"kubernetes.io/projected/23f585e7-9dc8-4831-9067-254219551c2d-kube-api-access-gdvkm\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:44.788803 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.788796 2539 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-oauth-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:44.788803 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:44.788806 2539 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/23f585e7-9dc8-4831-9067-254219551c2d-console-serving-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:42:45.322361 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:45.322322 2539 generic.go:356] "Generic (PLEG): container finished" podID="23f585e7-9dc8-4831-9067-254219551c2d" containerID="edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226" exitCode=0 Jul 06 17:42:45.322361 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:45.322362 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b5fcbfcb-rz28d" Jul 06 17:42:45.322843 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:45.322411 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b5fcbfcb-rz28d" event={"ID":"23f585e7-9dc8-4831-9067-254219551c2d","Type":"ContainerDied","Data":"edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226"} Jul 06 17:42:45.322843 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:45.322454 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b5fcbfcb-rz28d" event={"ID":"23f585e7-9dc8-4831-9067-254219551c2d","Type":"ContainerDied","Data":"19eaae3d3b97d222991e64519faf33d1523030d00aaf4fd5c537b20e92e3c713"} Jul 06 17:42:45.322843 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:45.322473 2539 scope.go:117] "RemoveContainer" containerID="edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226" Jul 06 17:42:45.331132 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:45.331115 2539 scope.go:117] "RemoveContainer" containerID="edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226" Jul 06 17:42:45.331392 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:42:45.331372 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226\": container with ID starting with edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226 not found: ID does not exist" containerID="edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226" Jul 06 17:42:45.331485 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:45.331398 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226"} err="failed to get container status \"edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226\": rpc error: code = NotFound desc = could not find container \"edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226\": container with ID starting with edf570e0c63b0f25b847d0ba3635b1f89ea5a23a35448cc2e3815057e4eda226 not found: ID does not exist" Jul 06 17:42:45.342816 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:45.342790 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b5fcbfcb-rz28d"] Jul 06 17:42:45.346377 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:45.346354 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9b5fcbfcb-rz28d"] Jul 06 17:42:46.302842 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:42:46.302809 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23f585e7-9dc8-4831-9067-254219551c2d" path="/var/lib/kubelet/pods/23f585e7-9dc8-4831-9067-254219551c2d/volumes" Jul 06 17:43:34.207159 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.207121 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:43:34.306797 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.306764 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:43:34.869673 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.869638 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq"] Jul 06 17:43:34.869932 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.869920 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f585e7-9dc8-4831-9067-254219551c2d" containerName="console" Jul 06 17:43:34.869973 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.869934 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f585e7-9dc8-4831-9067-254219551c2d" containerName="console" Jul 06 17:43:34.870010 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.869985 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="23f585e7-9dc8-4831-9067-254219551c2d" containerName="console" Jul 06 17:43:34.873255 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.873240 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:34.875756 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.875734 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 17:43:34.875861 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.875844 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 17:43:34.876941 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.876927 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kzlxq\"" Jul 06 17:43:34.881665 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.881642 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq"] Jul 06 17:43:34.953485 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.953441 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:34.953662 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.953511 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:34.953662 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:34.953536 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbbvv\" (UniqueName: \"kubernetes.io/projected/20551eff-431f-412b-a5d7-0bc368632485-kube-api-access-mbbvv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:35.054158 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:35.054107 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:35.054319 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:35.054190 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:35.054319 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:35.054214 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbbvv\" (UniqueName: \"kubernetes.io/projected/20551eff-431f-412b-a5d7-0bc368632485-kube-api-access-mbbvv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:35.054500 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:35.054480 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:35.054569 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:35.054548 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:35.062793 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:35.062764 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbbvv\" (UniqueName: \"kubernetes.io/projected/20551eff-431f-412b-a5d7-0bc368632485-kube-api-access-mbbvv\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:35.182623 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:35.182593 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:35.318743 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:35.318717 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq"] Jul 06 17:43:35.321535 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:43:35.321511 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20551eff_431f_412b_a5d7_0bc368632485.slice/crio-a51edfc5fad15a5f4f196af85facf0ab1cac62f6c0ce20be7236f9ead81b6a49 WatchSource:0}: Error finding container a51edfc5fad15a5f4f196af85facf0ab1cac62f6c0ce20be7236f9ead81b6a49: Status 404 returned error can't find the container with id a51edfc5fad15a5f4f196af85facf0ab1cac62f6c0ce20be7236f9ead81b6a49 Jul 06 17:43:35.501785 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:35.501681 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" event={"ID":"20551eff-431f-412b-a5d7-0bc368632485","Type":"ContainerStarted","Data":"a51edfc5fad15a5f4f196af85facf0ab1cac62f6c0ce20be7236f9ead81b6a49"} Jul 06 17:43:39.016665 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:39.016618 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:43:39.071569 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:39.071526 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:43:44.538479 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:44.538446 2539 generic.go:356] "Generic (PLEG): container finished" podID="20551eff-431f-412b-a5d7-0bc368632485" containerID="25014b80bc9b7932b1c2f9e2dadc76a4f23747fb009dc098d71975eb7378d371" exitCode=0 Jul 06 17:43:44.538921 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:44.538493 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" event={"ID":"20551eff-431f-412b-a5d7-0bc368632485","Type":"ContainerDied","Data":"25014b80bc9b7932b1c2f9e2dadc76a4f23747fb009dc098d71975eb7378d371"} Jul 06 17:43:47.551488 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:47.551403 2539 generic.go:356] "Generic (PLEG): container finished" podID="20551eff-431f-412b-a5d7-0bc368632485" containerID="00fc4ad80c7cfae8947235873d55db96dd5d1e538b7ea6fe9974812115439053" exitCode=0 Jul 06 17:43:47.551488 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:47.551469 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" event={"ID":"20551eff-431f-412b-a5d7-0bc368632485","Type":"ContainerDied","Data":"00fc4ad80c7cfae8947235873d55db96dd5d1e538b7ea6fe9974812115439053"} Jul 06 17:43:50.133303 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:50.133273 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:43:50.135552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:50.135529 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:43:50.137247 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:50.137232 2539 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 17:43:57.593985 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:57.593957 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" event={"ID":"20551eff-431f-412b-a5d7-0bc368632485","Type":"ContainerStarted","Data":"582081ef4b12af4761a8db5d48586485dde494cf6c7a222ce4009cff9dbf54af"} Jul 06 17:43:58.599685 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:58.599652 2539 generic.go:356] "Generic (PLEG): container finished" podID="20551eff-431f-412b-a5d7-0bc368632485" containerID="582081ef4b12af4761a8db5d48586485dde494cf6c7a222ce4009cff9dbf54af" exitCode=0 Jul 06 17:43:58.600118 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:58.599746 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" event={"ID":"20551eff-431f-412b-a5d7-0bc368632485","Type":"ContainerDied","Data":"582081ef4b12af4761a8db5d48586485dde494cf6c7a222ce4009cff9dbf54af"} Jul 06 17:43:59.730607 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:59.730583 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:43:59.879861 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:59.879754 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-bundle\") pod \"20551eff-431f-412b-a5d7-0bc368632485\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " Jul 06 17:43:59.879861 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:59.879812 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbbvv\" (UniqueName: \"kubernetes.io/projected/20551eff-431f-412b-a5d7-0bc368632485-kube-api-access-mbbvv\") pod \"20551eff-431f-412b-a5d7-0bc368632485\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " Jul 06 17:43:59.880071 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:59.879866 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-util\") pod \"20551eff-431f-412b-a5d7-0bc368632485\" (UID: \"20551eff-431f-412b-a5d7-0bc368632485\") " Jul 06 17:43:59.880566 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:59.880535 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-bundle" (OuterVolumeSpecName: "bundle") pod "20551eff-431f-412b-a5d7-0bc368632485" (UID: "20551eff-431f-412b-a5d7-0bc368632485"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:43:59.882187 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:59.882166 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20551eff-431f-412b-a5d7-0bc368632485-kube-api-access-mbbvv" (OuterVolumeSpecName: "kube-api-access-mbbvv") pod "20551eff-431f-412b-a5d7-0bc368632485" (UID: "20551eff-431f-412b-a5d7-0bc368632485"). InnerVolumeSpecName "kube-api-access-mbbvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:43:59.885840 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:59.885800 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-util" (OuterVolumeSpecName: "util") pod "20551eff-431f-412b-a5d7-0bc368632485" (UID: "20551eff-431f-412b-a5d7-0bc368632485"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:43:59.980891 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:59.980853 2539 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:43:59.980891 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:59.980884 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbbvv\" (UniqueName: \"kubernetes.io/projected/20551eff-431f-412b-a5d7-0bc368632485-kube-api-access-mbbvv\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:43:59.980891 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:43:59.980895 2539 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20551eff-431f-412b-a5d7-0bc368632485-util\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:44:00.609633 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:00.609550 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" Jul 06 17:44:00.609633 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:00.609562 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mvfjq" event={"ID":"20551eff-431f-412b-a5d7-0bc368632485","Type":"ContainerDied","Data":"a51edfc5fad15a5f4f196af85facf0ab1cac62f6c0ce20be7236f9ead81b6a49"} Jul 06 17:44:00.609633 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:00.609601 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a51edfc5fad15a5f4f196af85facf0ab1cac62f6c0ce20be7236f9ead81b6a49" Jul 06 17:44:05.962715 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:05.962663 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:06.753876 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:06.753848 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:07.885603 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.885575 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k"] Jul 06 17:44:07.885974 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.885866 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20551eff-431f-412b-a5d7-0bc368632485" containerName="extract" Jul 06 17:44:07.885974 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.885877 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="20551eff-431f-412b-a5d7-0bc368632485" containerName="extract" Jul 06 17:44:07.885974 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.885895 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20551eff-431f-412b-a5d7-0bc368632485" containerName="pull" Jul 06 17:44:07.885974 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.885900 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="20551eff-431f-412b-a5d7-0bc368632485" containerName="pull" Jul 06 17:44:07.885974 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.885907 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20551eff-431f-412b-a5d7-0bc368632485" containerName="util" Jul 06 17:44:07.885974 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.885914 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="20551eff-431f-412b-a5d7-0bc368632485" containerName="util" Jul 06 17:44:07.885974 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.885956 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="20551eff-431f-412b-a5d7-0bc368632485" containerName="extract" Jul 06 17:44:07.888007 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.887992 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" Jul 06 17:44:07.890705 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.890678 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 17:44:07.890857 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.890729 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-9s5gg\"" Jul 06 17:44:07.890857 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.890733 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:44:07.903981 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:07.903959 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k"] Jul 06 17:44:08.043074 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:08.043022 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pzm6\" (UniqueName: \"kubernetes.io/projected/1a03194f-f4bf-47af-9aef-467e6502bbb1-kube-api-access-2pzm6\") pod \"cert-manager-operator-controller-manager-55c444bf86-bfx9k\" (UID: \"1a03194f-f4bf-47af-9aef-467e6502bbb1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" Jul 06 17:44:08.043074 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:08.043076 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a03194f-f4bf-47af-9aef-467e6502bbb1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bfx9k\" (UID: \"1a03194f-f4bf-47af-9aef-467e6502bbb1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" Jul 06 17:44:08.144243 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:08.144146 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pzm6\" (UniqueName: \"kubernetes.io/projected/1a03194f-f4bf-47af-9aef-467e6502bbb1-kube-api-access-2pzm6\") pod \"cert-manager-operator-controller-manager-55c444bf86-bfx9k\" (UID: \"1a03194f-f4bf-47af-9aef-467e6502bbb1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" Jul 06 17:44:08.144243 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:08.144203 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a03194f-f4bf-47af-9aef-467e6502bbb1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bfx9k\" (UID: \"1a03194f-f4bf-47af-9aef-467e6502bbb1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" Jul 06 17:44:08.144565 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:08.144547 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a03194f-f4bf-47af-9aef-467e6502bbb1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bfx9k\" (UID: \"1a03194f-f4bf-47af-9aef-467e6502bbb1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" Jul 06 17:44:08.153839 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:08.153815 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pzm6\" (UniqueName: \"kubernetes.io/projected/1a03194f-f4bf-47af-9aef-467e6502bbb1-kube-api-access-2pzm6\") pod \"cert-manager-operator-controller-manager-55c444bf86-bfx9k\" (UID: \"1a03194f-f4bf-47af-9aef-467e6502bbb1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" Jul 06 17:44:08.197038 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:08.196994 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" Jul 06 17:44:08.332070 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:08.332044 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k"] Jul 06 17:44:08.334753 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:44:08.334684 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a03194f_f4bf_47af_9aef_467e6502bbb1.slice/crio-e073b6a400045284b8f7438797d188cf107da84273da939e7ea6db8ede0942f5 WatchSource:0}: Error finding container e073b6a400045284b8f7438797d188cf107da84273da939e7ea6db8ede0942f5: Status 404 returned error can't find the container with id e073b6a400045284b8f7438797d188cf107da84273da939e7ea6db8ede0942f5 Jul 06 17:44:08.337297 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:08.337280 2539 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:44:08.640549 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:08.640518 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" event={"ID":"1a03194f-f4bf-47af-9aef-467e6502bbb1","Type":"ContainerStarted","Data":"e073b6a400045284b8f7438797d188cf107da84273da939e7ea6db8ede0942f5"} Jul 06 17:44:09.585655 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:09.585605 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:09.684860 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:09.684828 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:10.651106 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:10.651074 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" event={"ID":"1a03194f-f4bf-47af-9aef-467e6502bbb1","Type":"ContainerStarted","Data":"df76092a40cd355b2fd6195f6d6c7c458158c619e40587223c5d6b7234444e9e"} Jul 06 17:44:10.672709 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:10.672644 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bfx9k" podStartSLOduration=1.891392716 podStartE2EDuration="3.672627394s" totalImagesPullingTime="1.781234678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:44:10.670095416 +0000 UTC m=+320.901340604" watchObservedRunningTime="2026-07-06 17:44:10.672627394 +0000 UTC m=+320.903872569" Jul 06 17:44:11.015502 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.015466 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:11.148105 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.148067 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:11.360268 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.360177 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:11.455549 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.455510 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:11.569855 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.569824 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kpxgj"] Jul 06 17:44:11.571982 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.571959 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" Jul 06 17:44:11.574950 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.574932 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 17:44:11.576060 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.576043 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2njrn\"" Jul 06 17:44:11.576143 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.576047 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 17:44:11.586067 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.586046 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kpxgj"] Jul 06 17:44:11.665694 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.665617 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp"] Jul 06 17:44:11.668327 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.668307 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:11.670909 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.670888 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kzlxq\"" Jul 06 17:44:11.671043 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.670983 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 17:44:11.671043 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.671028 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 17:44:11.674928 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.674785 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ade7795-5b8b-4a1c-9546-2460364fb36d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kpxgj\" (UID: \"0ade7795-5b8b-4a1c-9546-2460364fb36d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" Jul 06 17:44:11.674928 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.674894 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92qzc\" (UniqueName: \"kubernetes.io/projected/0ade7795-5b8b-4a1c-9546-2460364fb36d-kube-api-access-92qzc\") pod \"cert-manager-webhook-6486ffd997-kpxgj\" (UID: \"0ade7795-5b8b-4a1c-9546-2460364fb36d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" Jul 06 17:44:11.680891 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.680871 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp"] Jul 06 17:44:11.776097 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.776065 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:11.776304 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.776191 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:11.776304 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.776237 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92qzc\" (UniqueName: \"kubernetes.io/projected/0ade7795-5b8b-4a1c-9546-2460364fb36d-kube-api-access-92qzc\") pod \"cert-manager-webhook-6486ffd997-kpxgj\" (UID: \"0ade7795-5b8b-4a1c-9546-2460364fb36d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" Jul 06 17:44:11.776304 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.776282 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ade7795-5b8b-4a1c-9546-2460364fb36d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kpxgj\" (UID: \"0ade7795-5b8b-4a1c-9546-2460364fb36d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" Jul 06 17:44:11.776304 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.776302 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlj4k\" (UniqueName: \"kubernetes.io/projected/77975c03-48b2-441d-adae-bf412c02b7cb-kube-api-access-tlj4k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:11.784736 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.784686 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0ade7795-5b8b-4a1c-9546-2460364fb36d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kpxgj\" (UID: \"0ade7795-5b8b-4a1c-9546-2460364fb36d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" Jul 06 17:44:11.784904 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.784775 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92qzc\" (UniqueName: \"kubernetes.io/projected/0ade7795-5b8b-4a1c-9546-2460364fb36d-kube-api-access-92qzc\") pod \"cert-manager-webhook-6486ffd997-kpxgj\" (UID: \"0ade7795-5b8b-4a1c-9546-2460364fb36d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" Jul 06 17:44:11.877164 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.877122 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:11.877338 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.877183 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:11.877338 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.877219 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlj4k\" (UniqueName: \"kubernetes.io/projected/77975c03-48b2-441d-adae-bf412c02b7cb-kube-api-access-tlj4k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:11.877565 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.877544 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:11.877600 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.877553 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:11.886971 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.886938 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlj4k\" (UniqueName: \"kubernetes.io/projected/77975c03-48b2-441d-adae-bf412c02b7cb-kube-api-access-tlj4k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:11.895805 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.895783 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" Jul 06 17:44:11.978108 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:11.978057 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:12.029523 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:12.029490 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kpxgj"] Jul 06 17:44:12.033456 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:44:12.033403 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ade7795_5b8b_4a1c_9546_2460364fb36d.slice/crio-f02a855dc7d6612d8523d5f4cc66ca810b5864bd3371b7fb8a7b89235aac0874 WatchSource:0}: Error finding container f02a855dc7d6612d8523d5f4cc66ca810b5864bd3371b7fb8a7b89235aac0874: Status 404 returned error can't find the container with id f02a855dc7d6612d8523d5f4cc66ca810b5864bd3371b7fb8a7b89235aac0874 Jul 06 17:44:12.114467 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:12.114441 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp"] Jul 06 17:44:12.116851 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:44:12.116823 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77975c03_48b2_441d_adae_bf412c02b7cb.slice/crio-df097e1b858ab1e253826743ead40c614bdcbbf4a6516a3d8608f7133ae30a26 WatchSource:0}: Error finding container df097e1b858ab1e253826743ead40c614bdcbbf4a6516a3d8608f7133ae30a26: Status 404 returned error can't find the container with id df097e1b858ab1e253826743ead40c614bdcbbf4a6516a3d8608f7133ae30a26 Jul 06 17:44:12.661117 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:12.661030 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" event={"ID":"0ade7795-5b8b-4a1c-9546-2460364fb36d","Type":"ContainerStarted","Data":"f02a855dc7d6612d8523d5f4cc66ca810b5864bd3371b7fb8a7b89235aac0874"} Jul 06 17:44:12.662359 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:12.662326 2539 generic.go:356] "Generic (PLEG): container finished" podID="77975c03-48b2-441d-adae-bf412c02b7cb" containerID="6821a20a9f9bf11eb4eeefa78c8ef053e784a0ff478e997f4d768de402d547c4" exitCode=0 Jul 06 17:44:12.662491 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:12.662408 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" event={"ID":"77975c03-48b2-441d-adae-bf412c02b7cb","Type":"ContainerDied","Data":"6821a20a9f9bf11eb4eeefa78c8ef053e784a0ff478e997f4d768de402d547c4"} Jul 06 17:44:12.662491 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:12.662450 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" event={"ID":"77975c03-48b2-441d-adae-bf412c02b7cb","Type":"ContainerStarted","Data":"df097e1b858ab1e253826743ead40c614bdcbbf4a6516a3d8608f7133ae30a26"} Jul 06 17:44:13.729052 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:13.729011 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:14.128380 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:14.128290 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:16.369624 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:16.369587 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:16.429542 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:16.429506 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:21.933691 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:21.933627 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:22.071158 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.071113 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2qxnl"] Jul 06 17:44:22.081749 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.081654 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2qxnl" Jul 06 17:44:22.084157 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.084121 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2qxnl"] Jul 06 17:44:22.084330 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.084307 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fncqr\"" Jul 06 17:44:22.152112 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.152075 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jstgl\" (UniqueName: \"kubernetes.io/projected/bfdda43e-a1fb-4796-b3e0-3472fdc8b34f-kube-api-access-jstgl\") pod \"cert-manager-55b4d954d5-2qxnl\" (UID: \"bfdda43e-a1fb-4796-b3e0-3472fdc8b34f\") " pod="cert-manager/cert-manager-55b4d954d5-2qxnl" Jul 06 17:44:22.152296 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.152182 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfdda43e-a1fb-4796-b3e0-3472fdc8b34f-bound-sa-token\") pod \"cert-manager-55b4d954d5-2qxnl\" (UID: \"bfdda43e-a1fb-4796-b3e0-3472fdc8b34f\") " pod="cert-manager/cert-manager-55b4d954d5-2qxnl" Jul 06 17:44:22.252867 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.252781 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jstgl\" (UniqueName: \"kubernetes.io/projected/bfdda43e-a1fb-4796-b3e0-3472fdc8b34f-kube-api-access-jstgl\") pod \"cert-manager-55b4d954d5-2qxnl\" (UID: \"bfdda43e-a1fb-4796-b3e0-3472fdc8b34f\") " pod="cert-manager/cert-manager-55b4d954d5-2qxnl" Jul 06 17:44:22.253054 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.252897 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfdda43e-a1fb-4796-b3e0-3472fdc8b34f-bound-sa-token\") pod \"cert-manager-55b4d954d5-2qxnl\" (UID: \"bfdda43e-a1fb-4796-b3e0-3472fdc8b34f\") " pod="cert-manager/cert-manager-55b4d954d5-2qxnl" Jul 06 17:44:22.261164 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.261128 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfdda43e-a1fb-4796-b3e0-3472fdc8b34f-bound-sa-token\") pod \"cert-manager-55b4d954d5-2qxnl\" (UID: \"bfdda43e-a1fb-4796-b3e0-3472fdc8b34f\") " pod="cert-manager/cert-manager-55b4d954d5-2qxnl" Jul 06 17:44:22.261308 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.261228 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jstgl\" (UniqueName: \"kubernetes.io/projected/bfdda43e-a1fb-4796-b3e0-3472fdc8b34f-kube-api-access-jstgl\") pod \"cert-manager-55b4d954d5-2qxnl\" (UID: \"bfdda43e-a1fb-4796-b3e0-3472fdc8b34f\") " pod="cert-manager/cert-manager-55b4d954d5-2qxnl" Jul 06 17:44:22.393912 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.393871 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2qxnl" Jul 06 17:44:22.919370 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:22.919341 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2qxnl"] Jul 06 17:44:22.923691 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:44:22.923669 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfdda43e_a1fb_4796_b3e0_3472fdc8b34f.slice/crio-ec22aa3c3e82d66df52136d85acebb2dfec9e5bb89ffd8c8f17ae1a15c1e7442 WatchSource:0}: Error finding container ec22aa3c3e82d66df52136d85acebb2dfec9e5bb89ffd8c8f17ae1a15c1e7442: Status 404 returned error can't find the container with id ec22aa3c3e82d66df52136d85acebb2dfec9e5bb89ffd8c8f17ae1a15c1e7442 Jul 06 17:44:23.711416 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:23.711376 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2qxnl" event={"ID":"bfdda43e-a1fb-4796-b3e0-3472fdc8b34f","Type":"ContainerStarted","Data":"118238903b47fdf514952b7056038b633a0954ec0f936bf67acb753bfd4903e1"} Jul 06 17:44:23.711926 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:23.711434 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2qxnl" event={"ID":"bfdda43e-a1fb-4796-b3e0-3472fdc8b34f","Type":"ContainerStarted","Data":"ec22aa3c3e82d66df52136d85acebb2dfec9e5bb89ffd8c8f17ae1a15c1e7442"} Jul 06 17:44:23.712824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:23.712805 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" event={"ID":"0ade7795-5b8b-4a1c-9546-2460364fb36d","Type":"ContainerStarted","Data":"8cae01381b5d08d1a93044de0ece9b9659671ecaba5bd0211fc304ae6ec684ae"} Jul 06 17:44:23.712946 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:23.712931 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" Jul 06 17:44:23.741473 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:23.741416 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" podStartSLOduration=1.921774282 podStartE2EDuration="12.741401566s" totalImagesPullingTime="10.819627284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:44:23.740003672 +0000 UTC m=+333.971248848" watchObservedRunningTime="2026-07-06 17:44:23.741401566 +0000 UTC m=+333.972646739" Jul 06 17:44:23.742114 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:23.742078 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2qxnl" podStartSLOduration=1.742064477 podStartE2EDuration="1.742064477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:44:23.725848822 +0000 UTC m=+333.957093999" watchObservedRunningTime="2026-07-06 17:44:23.742064477 +0000 UTC m=+333.973309655" Jul 06 17:44:24.072133 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:24.072047 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:24.172214 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:24.172174 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:27.731827 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:27.731790 2539 generic.go:356] "Generic (PLEG): container finished" podID="77975c03-48b2-441d-adae-bf412c02b7cb" containerID="bfcd1504f9109db8a512f513b8d5ee8c21c03f2d12fbc3674e05e0e404c181d1" exitCode=0 Jul 06 17:44:27.732239 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:27.731886 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" event={"ID":"77975c03-48b2-441d-adae-bf412c02b7cb","Type":"ContainerDied","Data":"bfcd1504f9109db8a512f513b8d5ee8c21c03f2d12fbc3674e05e0e404c181d1"} Jul 06 17:44:28.737830 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:28.737790 2539 generic.go:356] "Generic (PLEG): container finished" podID="77975c03-48b2-441d-adae-bf412c02b7cb" containerID="28bb5b1492f7e28e562f816d12564cf13a909016371fb00e7580f3fa7395c4b7" exitCode=0 Jul 06 17:44:28.738179 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:28.737842 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" event={"ID":"77975c03-48b2-441d-adae-bf412c02b7cb","Type":"ContainerDied","Data":"28bb5b1492f7e28e562f816d12564cf13a909016371fb00e7580f3fa7395c4b7"} Jul 06 17:44:29.719221 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:29.719196 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kpxgj" Jul 06 17:44:29.865938 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:29.865914 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:29.917182 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:29.917151 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-bundle\") pod \"77975c03-48b2-441d-adae-bf412c02b7cb\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " Jul 06 17:44:29.917318 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:29.917189 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlj4k\" (UniqueName: \"kubernetes.io/projected/77975c03-48b2-441d-adae-bf412c02b7cb-kube-api-access-tlj4k\") pod \"77975c03-48b2-441d-adae-bf412c02b7cb\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " Jul 06 17:44:29.917318 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:29.917227 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-util\") pod \"77975c03-48b2-441d-adae-bf412c02b7cb\" (UID: \"77975c03-48b2-441d-adae-bf412c02b7cb\") " Jul 06 17:44:29.917536 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:29.917492 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-bundle" (OuterVolumeSpecName: "bundle") pod "77975c03-48b2-441d-adae-bf412c02b7cb" (UID: "77975c03-48b2-441d-adae-bf412c02b7cb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:44:29.919400 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:29.919377 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77975c03-48b2-441d-adae-bf412c02b7cb-kube-api-access-tlj4k" (OuterVolumeSpecName: "kube-api-access-tlj4k") pod "77975c03-48b2-441d-adae-bf412c02b7cb" (UID: "77975c03-48b2-441d-adae-bf412c02b7cb"). InnerVolumeSpecName "kube-api-access-tlj4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:44:29.921567 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:29.921546 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-util" (OuterVolumeSpecName: "util") pod "77975c03-48b2-441d-adae-bf412c02b7cb" (UID: "77975c03-48b2-441d-adae-bf412c02b7cb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:44:30.018095 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:30.018020 2539 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-util\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:44:30.018095 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:30.018046 2539 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77975c03-48b2-441d-adae-bf412c02b7cb-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:44:30.018095 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:30.018057 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlj4k\" (UniqueName: \"kubernetes.io/projected/77975c03-48b2-441d-adae-bf412c02b7cb-kube-api-access-tlj4k\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:44:30.748092 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:30.748063 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" Jul 06 17:44:30.748092 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:30.748080 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fr2jcp" event={"ID":"77975c03-48b2-441d-adae-bf412c02b7cb","Type":"ContainerDied","Data":"df097e1b858ab1e253826743ead40c614bdcbbf4a6516a3d8608f7133ae30a26"} Jul 06 17:44:30.748295 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:30.748120 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df097e1b858ab1e253826743ead40c614bdcbbf4a6516a3d8608f7133ae30a26" Jul 06 17:44:33.891177 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:33.891141 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:35.163296 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:35.163257 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:44.198857 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:44.198775 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:44.316138 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:44.316089 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:45.940747 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.940715 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx"] Jul 06 17:44:45.941616 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.941579 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77975c03-48b2-441d-adae-bf412c02b7cb" containerName="util" Jul 06 17:44:45.941616 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.941613 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="77975c03-48b2-441d-adae-bf412c02b7cb" containerName="util" Jul 06 17:44:45.941824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.941636 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77975c03-48b2-441d-adae-bf412c02b7cb" containerName="extract" Jul 06 17:44:45.941824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.941645 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="77975c03-48b2-441d-adae-bf412c02b7cb" containerName="extract" Jul 06 17:44:45.941824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.941667 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77975c03-48b2-441d-adae-bf412c02b7cb" containerName="pull" Jul 06 17:44:45.941824 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.941676 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="77975c03-48b2-441d-adae-bf412c02b7cb" containerName="pull" Jul 06 17:44:45.942009 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.941906 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="77975c03-48b2-441d-adae-bf412c02b7cb" containerName="extract" Jul 06 17:44:45.948773 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.946469 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:45.949789 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.949767 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 17:44:45.950565 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.950544 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kzlxq\"" Jul 06 17:44:45.950675 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.950565 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 17:44:45.954502 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:45.954387 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx"] Jul 06 17:44:46.037365 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.037334 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:46.037365 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.037376 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:46.037583 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.037422 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkl5c\" (UniqueName: \"kubernetes.io/projected/183c4ab7-68a0-472e-9ce0-3a3c264c2030-kube-api-access-rkl5c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:46.062882 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.062849 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:46.138667 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.138633 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:46.138870 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.138686 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkl5c\" (UniqueName: \"kubernetes.io/projected/183c4ab7-68a0-472e-9ce0-3a3c264c2030-kube-api-access-rkl5c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:46.138870 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.138765 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:46.139035 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.139013 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:46.139095 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.139035 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:46.147449 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.147432 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkl5c\" (UniqueName: \"kubernetes.io/projected/183c4ab7-68a0-472e-9ce0-3a3c264c2030-kube-api-access-rkl5c\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:46.258576 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.258495 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:46.385505 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.385482 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx"] Jul 06 17:44:46.387414 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:44:46.387388 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183c4ab7_68a0_472e_9ce0_3a3c264c2030.slice/crio-3a88d06d92905d8d0482c25117dde8ad4edbdb059dcb0a374322d34b1e00880d WatchSource:0}: Error finding container 3a88d06d92905d8d0482c25117dde8ad4edbdb059dcb0a374322d34b1e00880d: Status 404 returned error can't find the container with id 3a88d06d92905d8d0482c25117dde8ad4edbdb059dcb0a374322d34b1e00880d Jul 06 17:44:46.815739 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.815686 2539 generic.go:356] "Generic (PLEG): container finished" podID="183c4ab7-68a0-472e-9ce0-3a3c264c2030" containerID="32c990cd38c541e214402fab3293dd90c72893c74045b21f34975220b436d0b6" exitCode=0 Jul 06 17:44:46.815739 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.815742 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" event={"ID":"183c4ab7-68a0-472e-9ce0-3a3c264c2030","Type":"ContainerDied","Data":"32c990cd38c541e214402fab3293dd90c72893c74045b21f34975220b436d0b6"} Jul 06 17:44:46.815987 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:46.815776 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" event={"ID":"183c4ab7-68a0-472e-9ce0-3a3c264c2030","Type":"ContainerStarted","Data":"3a88d06d92905d8d0482c25117dde8ad4edbdb059dcb0a374322d34b1e00880d"} Jul 06 17:44:47.822043 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:47.822009 2539 generic.go:356] "Generic (PLEG): container finished" podID="183c4ab7-68a0-472e-9ce0-3a3c264c2030" containerID="3faf7502e7a1a7d1835d5651b23343aad04124abc08d3ba0bf6e7fc2cdb0a040" exitCode=0 Jul 06 17:44:47.822431 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:47.822073 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" event={"ID":"183c4ab7-68a0-472e-9ce0-3a3c264c2030","Type":"ContainerDied","Data":"3faf7502e7a1a7d1835d5651b23343aad04124abc08d3ba0bf6e7fc2cdb0a040"} Jul 06 17:44:48.827645 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:48.827607 2539 generic.go:356] "Generic (PLEG): container finished" podID="183c4ab7-68a0-472e-9ce0-3a3c264c2030" containerID="f19620985a5c2a4c448c8dd302de35f3fa6fb5cce282cfe09cdeaf3506bc7208" exitCode=0 Jul 06 17:44:48.828084 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:48.827738 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" event={"ID":"183c4ab7-68a0-472e-9ce0-3a3c264c2030","Type":"ContainerDied","Data":"f19620985a5c2a4c448c8dd302de35f3fa6fb5cce282cfe09cdeaf3506bc7208"} Jul 06 17:44:49.949424 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:49.949404 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:50.074346 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.074318 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-util\") pod \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " Jul 06 17:44:50.074499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.074354 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkl5c\" (UniqueName: \"kubernetes.io/projected/183c4ab7-68a0-472e-9ce0-3a3c264c2030-kube-api-access-rkl5c\") pod \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " Jul 06 17:44:50.074499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.074393 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-bundle\") pod \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\" (UID: \"183c4ab7-68a0-472e-9ce0-3a3c264c2030\") " Jul 06 17:44:50.075150 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.075123 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-bundle" (OuterVolumeSpecName: "bundle") pod "183c4ab7-68a0-472e-9ce0-3a3c264c2030" (UID: "183c4ab7-68a0-472e-9ce0-3a3c264c2030"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:44:50.076548 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.076525 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183c4ab7-68a0-472e-9ce0-3a3c264c2030-kube-api-access-rkl5c" (OuterVolumeSpecName: "kube-api-access-rkl5c") pod "183c4ab7-68a0-472e-9ce0-3a3c264c2030" (UID: "183c4ab7-68a0-472e-9ce0-3a3c264c2030"). InnerVolumeSpecName "kube-api-access-rkl5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:44:50.079627 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.079595 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-util" (OuterVolumeSpecName: "util") pod "183c4ab7-68a0-472e-9ce0-3a3c264c2030" (UID: "183c4ab7-68a0-472e-9ce0-3a3c264c2030"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:44:50.175104 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.175080 2539 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-util\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:44:50.175104 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.175104 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkl5c\" (UniqueName: \"kubernetes.io/projected/183c4ab7-68a0-472e-9ce0-3a3c264c2030-kube-api-access-rkl5c\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:44:50.175266 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.175117 2539 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/183c4ab7-68a0-472e-9ce0-3a3c264c2030-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:44:50.838904 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.838866 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" event={"ID":"183c4ab7-68a0-472e-9ce0-3a3c264c2030","Type":"ContainerDied","Data":"3a88d06d92905d8d0482c25117dde8ad4edbdb059dcb0a374322d34b1e00880d"} Jul 06 17:44:50.838904 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.838891 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8z6bx" Jul 06 17:44:50.839126 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:50.838925 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a88d06d92905d8d0482c25117dde8ad4edbdb059dcb0a374322d34b1e00880d" Jul 06 17:44:58.261354 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.261323 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:58.374197 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.374140 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:58.428574 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.428545 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh"] Jul 06 17:44:58.428852 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.428838 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183c4ab7-68a0-472e-9ce0-3a3c264c2030" containerName="extract" Jul 06 17:44:58.428923 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.428854 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="183c4ab7-68a0-472e-9ce0-3a3c264c2030" containerName="extract" Jul 06 17:44:58.428923 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.428868 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183c4ab7-68a0-472e-9ce0-3a3c264c2030" containerName="util" Jul 06 17:44:58.428923 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.428874 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="183c4ab7-68a0-472e-9ce0-3a3c264c2030" containerName="util" Jul 06 17:44:58.428923 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.428884 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183c4ab7-68a0-472e-9ce0-3a3c264c2030" containerName="pull" Jul 06 17:44:58.428923 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.428889 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="183c4ab7-68a0-472e-9ce0-3a3c264c2030" containerName="pull" Jul 06 17:44:58.429121 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.428939 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="183c4ab7-68a0-472e-9ce0-3a3c264c2030" containerName="extract" Jul 06 17:44:58.431623 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.431606 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.434643 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.434621 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7qxkd\"" Jul 06 17:44:58.435959 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.435928 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 17:44:58.435959 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.435942 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 17:44:58.436103 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.435992 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 17:44:58.436103 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.435934 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 17:44:58.436103 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.436051 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 17:44:58.444394 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.444376 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh"] Jul 06 17:44:58.469348 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.469316 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:58.543646 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.543574 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fnrt\" (UniqueName: \"kubernetes.io/projected/fd3c027d-0696-4273-93a7-20c248dcc1ff-kube-api-access-9fnrt\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.543646 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.543617 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd3c027d-0696-4273-93a7-20c248dcc1ff-metrics-cert\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.543646 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.543639 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fd3c027d-0696-4273-93a7-20c248dcc1ff-manager-config\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.543857 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.543727 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd3c027d-0696-4273-93a7-20c248dcc1ff-cert\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.644774 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.644736 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnrt\" (UniqueName: \"kubernetes.io/projected/fd3c027d-0696-4273-93a7-20c248dcc1ff-kube-api-access-9fnrt\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.644971 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.644787 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd3c027d-0696-4273-93a7-20c248dcc1ff-metrics-cert\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.644971 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.644808 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fd3c027d-0696-4273-93a7-20c248dcc1ff-manager-config\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.644971 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.644933 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd3c027d-0696-4273-93a7-20c248dcc1ff-cert\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.645401 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.645383 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fd3c027d-0696-4273-93a7-20c248dcc1ff-manager-config\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.647247 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.647225 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd3c027d-0696-4273-93a7-20c248dcc1ff-cert\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.647466 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.647444 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd3c027d-0696-4273-93a7-20c248dcc1ff-metrics-cert\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.653432 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.653412 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fnrt\" (UniqueName: \"kubernetes.io/projected/fd3c027d-0696-4273-93a7-20c248dcc1ff-kube-api-access-9fnrt\") pod \"lws-controller-manager-68c469dbcb-sb7hh\" (UID: \"fd3c027d-0696-4273-93a7-20c248dcc1ff\") " pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.742431 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.742398 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:44:58.877820 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.877792 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:58.882889 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:58.882870 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh"] Jul 06 17:44:58.884924 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:44:58.884894 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd3c027d_0696_4273_93a7_20c248dcc1ff.slice/crio-8d1a4b406612e31efa0b2c9f7c53650d8c0d62d5f2b4e5d3ab44e5e5f9657947 WatchSource:0}: Error finding container 8d1a4b406612e31efa0b2c9f7c53650d8c0d62d5f2b4e5d3ab44e5e5f9657947: Status 404 returned error can't find the container with id 8d1a4b406612e31efa0b2c9f7c53650d8c0d62d5f2b4e5d3ab44e5e5f9657947 Jul 06 17:44:59.140719 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.140610 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:59.241277 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.241240 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:59.289821 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.289792 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk"] Jul 06 17:44:59.292721 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.292681 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.296050 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.296024 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 17:44:59.296157 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.296114 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bk52m\"" Jul 06 17:44:59.296443 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.296426 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 17:44:59.296494 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.296454 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 17:44:59.297237 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.297218 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 17:44:59.312211 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.312177 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk"] Jul 06 17:44:59.452015 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.451983 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-webhook-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.452179 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.452024 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbc5\" (UniqueName: \"kubernetes.io/projected/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-kube-api-access-4xbc5\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.452179 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.452049 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-manifests\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.452260 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.452198 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.452301 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.452258 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-tmp\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.469272 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.469237 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:59.553550 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.553517 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.553550 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.553561 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-tmp\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.553830 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.553594 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-webhook-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.553830 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.553621 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbc5\" (UniqueName: \"kubernetes.io/projected/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-kube-api-access-4xbc5\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.553830 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.553652 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-manifests\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.554077 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.554056 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-manifests\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.555926 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.555902 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-tmp\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.556132 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.556113 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-apiservice-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.556198 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.556171 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-webhook-cert\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.562478 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.562450 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:59.562765 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.562749 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbc5\" (UniqueName: \"kubernetes.io/projected/e9b60eb0-8d37-4048-bd74-7ff20a22ad97-kube-api-access-4xbc5\") pod \"opendatahub-operator-controller-manager-597bcb8998-k4dkk\" (UID: \"e9b60eb0-8d37-4048-bd74-7ff20a22ad97\") " pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.603856 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.603820 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:44:59.666530 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.666470 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:59.736864 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.736784 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:59.774813 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.774786 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk"] Jul 06 17:44:59.776912 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:44:59.776884 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b60eb0_8d37_4048_bd74_7ff20a22ad97.slice/crio-87d9c6752f157b309bf5d6ba2fc3266d16d82dfe11a4ff96e920b77104079c96 WatchSource:0}: Error finding container 87d9c6752f157b309bf5d6ba2fc3266d16d82dfe11a4ff96e920b77104079c96: Status 404 returned error can't find the container with id 87d9c6752f157b309bf5d6ba2fc3266d16d82dfe11a4ff96e920b77104079c96 Jul 06 17:44:59.826976 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.826937 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:44:59.880755 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.880692 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" event={"ID":"e9b60eb0-8d37-4048-bd74-7ff20a22ad97","Type":"ContainerStarted","Data":"87d9c6752f157b309bf5d6ba2fc3266d16d82dfe11a4ff96e920b77104079c96"} Jul 06 17:44:59.881985 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.881956 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" event={"ID":"fd3c027d-0696-4273-93a7-20c248dcc1ff","Type":"ContainerStarted","Data":"8d1a4b406612e31efa0b2c9f7c53650d8c0d62d5f2b4e5d3ab44e5e5f9657947"} Jul 06 17:44:59.922235 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:44:59.922204 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:00.890447 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:00.890407 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" event={"ID":"fd3c027d-0696-4273-93a7-20c248dcc1ff","Type":"ContainerStarted","Data":"36553e06a86b336df6757ef9e263247623c801e04404a7db3451e6e7fbd55782"} Jul 06 17:45:00.890910 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:00.890565 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:45:00.909186 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:00.909127 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" podStartSLOduration=1.393324054 podStartE2EDuration="2.909106635s" totalImagesPullingTime="1.515782581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:00.906649818 +0000 UTC m=+371.137894993" watchObservedRunningTime="2026-07-06 17:45:00.909106635 +0000 UTC m=+371.140351810" Jul 06 17:45:03.908385 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:03.908342 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" event={"ID":"e9b60eb0-8d37-4048-bd74-7ff20a22ad97","Type":"ContainerStarted","Data":"2c38d990cb305938915a23ec62059b2736c78b02a0a03b3b104554f9df11e444"} Jul 06 17:45:04.913714 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:04.913665 2539 generic.go:356] "Generic (PLEG): container finished" podID="e9b60eb0-8d37-4048-bd74-7ff20a22ad97" containerID="2c38d990cb305938915a23ec62059b2736c78b02a0a03b3b104554f9df11e444" exitCode=0 Jul 06 17:45:04.914189 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:04.913738 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" event={"ID":"e9b60eb0-8d37-4048-bd74-7ff20a22ad97","Type":"ContainerDied","Data":"2c38d990cb305938915a23ec62059b2736c78b02a0a03b3b104554f9df11e444"} Jul 06 17:45:05.920837 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:05.920801 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" event={"ID":"e9b60eb0-8d37-4048-bd74-7ff20a22ad97","Type":"ContainerStarted","Data":"1e1b35e235f21ee550002899903f03fd27d0723136d8458ee762aa932e41f6da"} Jul 06 17:45:05.921229 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:05.920883 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:45:05.942606 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:05.942551 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" podStartSLOduration=2.44413182 podStartE2EDuration="6.94253534s" totalImagesPullingTime="3.425507258s" totalInitContainerRuntime="1.072896262s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:44:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:05.940099972 +0000 UTC m=+376.171345174" watchObservedRunningTime="2026-07-06 17:45:05.94253534 +0000 UTC m=+376.173780515" Jul 06 17:45:11.898832 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:11.898801 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68c469dbcb-sb7hh" Jul 06 17:45:16.928296 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:16.928261 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-597bcb8998-k4dkk" Jul 06 17:45:18.497171 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:18.497135 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:18.592449 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:18.592411 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:18.838978 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:18.838885 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:18.966479 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:18.966449 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:19.302246 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:19.302208 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:19.374154 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:19.374109 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:19.446499 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:19.446467 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:19.630800 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:19.630679 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:20.132301 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:20.132260 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:20.350506 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:20.350474 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:20.430048 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:20.430014 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:21.391243 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:21.391207 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:26.050312 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.050280 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:26.149723 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.149665 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:26.371204 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.371112 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:26.458191 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.458148 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:26.717350 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.717319 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c"] Jul 06 17:45:26.721901 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.721872 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.724579 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.724541 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 17:45:26.724727 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.724612 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-psbm6\"" Jul 06 17:45:26.733688 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.733665 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs"] Jul 06 17:45:26.736986 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.736966 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c"] Jul 06 17:45:26.737081 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.737071 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.740074 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.740042 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 17:45:26.740185 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.740074 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 17:45:26.740185 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.740111 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 17:45:26.740185 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.740140 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pqnqn\"" Jul 06 17:45:26.755929 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.755906 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs"] Jul 06 17:45:26.766264 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.766239 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:26.785790 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.785758 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.785790 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.785789 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.785972 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.785810 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.785972 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.785827 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6142c87d-c309-4690-9e5e-7a18c883e7b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.785972 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.785894 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.785972 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.785957 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xtnm\" (UniqueName: \"kubernetes.io/projected/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-kube-api-access-9xtnm\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.786108 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.785989 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2646\" (UniqueName: \"kubernetes.io/projected/6142c87d-c309-4690-9e5e-7a18c883e7b0-kube-api-access-z2646\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.786108 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.786022 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.786108 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.786065 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.786108 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.786101 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.786242 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.786139 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.786242 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.786159 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.786242 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.786174 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.786242 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.786190 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.786242 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.786207 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.786403 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.786252 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.886903 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.886864 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.887105 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.886909 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.887105 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.886952 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887105 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.886980 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.887105 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887001 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887105 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887023 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.887105 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887050 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887422 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887174 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887422 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887230 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887422 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887259 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.887422 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887291 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887422 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887316 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6142c87d-c309-4690-9e5e-7a18c883e7b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887422 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887354 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887422 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887397 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xtnm\" (UniqueName: \"kubernetes.io/projected/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-kube-api-access-9xtnm\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.887790 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887433 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2646\" (UniqueName: \"kubernetes.io/projected/6142c87d-c309-4690-9e5e-7a18c883e7b0-kube-api-access-z2646\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887790 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887474 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.887790 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887548 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887790 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887569 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887790 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887616 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.887790 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.887398 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.888482 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.888458 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6142c87d-c309-4690-9e5e-7a18c883e7b0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.888558 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.888476 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.889882 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.889851 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.889991 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.889956 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.890300 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.890274 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.890413 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.890397 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.890546 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.890520 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.891008 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.890991 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.906654 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.906619 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6142c87d-c309-4690-9e5e-7a18c883e7b0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.907066 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.907046 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xtnm\" (UniqueName: \"kubernetes.io/projected/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-kube-api-access-9xtnm\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:26.907237 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.907214 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2646\" (UniqueName: \"kubernetes.io/projected/6142c87d-c309-4690-9e5e-7a18c883e7b0-kube-api-access-z2646\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4l6l8c\" (UID: \"6142c87d-c309-4690-9e5e-7a18c883e7b0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:26.908228 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:26.908205 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2vtbs\" (UID: \"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:27.032497 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:27.032388 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:27.048817 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:27.048789 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:27.072113 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:27.072075 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:27.188613 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:27.188555 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c"] Jul 06 17:45:27.190874 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:45:27.190847 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6142c87d_c309_4690_9e5e_7a18c883e7b0.slice/crio-2fbdb6b3fd9659d49d8280eb4c28607813b1f1f8e92a0809cc21649b2590d8a4 WatchSource:0}: Error finding container 2fbdb6b3fd9659d49d8280eb4c28607813b1f1f8e92a0809cc21649b2590d8a4: Status 404 returned error can't find the container with id 2fbdb6b3fd9659d49d8280eb4c28607813b1f1f8e92a0809cc21649b2590d8a4 Jul 06 17:45:27.196559 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:27.196529 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:27.211421 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:27.211395 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs"] Jul 06 17:45:27.214833 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:45:27.214809 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe40c6d_da74_479b_bb8e_1ddcc4d0e60e.slice/crio-860ca6c5a0db87119d0d5dd95b6db8319ce8b8c8ff6d24c6d0ecbf44f579f4ca WatchSource:0}: Error finding container 860ca6c5a0db87119d0d5dd95b6db8319ce8b8c8ff6d24c6d0ecbf44f579f4ca: Status 404 returned error can't find the container with id 860ca6c5a0db87119d0d5dd95b6db8319ce8b8c8ff6d24c6d0ecbf44f579f4ca Jul 06 17:45:28.020250 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:28.020213 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" event={"ID":"6142c87d-c309-4690-9e5e-7a18c883e7b0","Type":"ContainerStarted","Data":"2fbdb6b3fd9659d49d8280eb4c28607813b1f1f8e92a0809cc21649b2590d8a4"} Jul 06 17:45:28.022286 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:28.022255 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" event={"ID":"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e","Type":"ContainerStarted","Data":"860ca6c5a0db87119d0d5dd95b6db8319ce8b8c8ff6d24c6d0ecbf44f579f4ca"} Jul 06 17:45:28.124409 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:28.124372 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:28.225783 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:28.225746 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:29.570672 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:29.570640 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:29.664001 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:29.663905 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:29.827384 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:29.827307 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:30.162302 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:30.162218 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:30.767450 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:30.767407 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:45:30.767755 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:30.767479 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:45:30.771406 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:30.771373 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:45:30.771469 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:30.771435 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:45:30.771469 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:30.771465 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:45:30.878882 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:30.878584 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:31.025632 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:31.025533 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:31.042667 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:31.042629 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" event={"ID":"6142c87d-c309-4690-9e5e-7a18c883e7b0","Type":"ContainerStarted","Data":"5a1bb6fcf1ab80dc248f65b5d773937312460f7bff79311dd1ebba3369387128"} Jul 06 17:45:31.044368 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:31.044344 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" event={"ID":"6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e","Type":"ContainerStarted","Data":"e43bd69b22e5a2b2f59bdeeb0a02b5adf768a6c095cf42a3936596ac40095062"} Jul 06 17:45:31.044564 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:31.044545 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:31.046391 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:31.046371 2539 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-2vtbs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 17:45:31.046483 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:31.046433 2539 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" podUID="6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 17:45:31.098281 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:31.098229 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" podStartSLOduration=1.5479761920000001 podStartE2EDuration="5.098212858s" totalImagesPullingTime="3.550236666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:31.095803063 +0000 UTC m=+401.327048228" watchObservedRunningTime="2026-07-06 17:45:31.098212858 +0000 UTC m=+401.329458033" Jul 06 17:45:31.098440 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:31.098411 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" podStartSLOduration=1.520102755 podStartE2EDuration="5.098403881s" totalImagesPullingTime="3.578301126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:45:31.073132128 +0000 UTC m=+401.304377303" watchObservedRunningTime="2026-07-06 17:45:31.098403881 +0000 UTC m=+401.329649063" Jul 06 17:45:31.138681 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:31.138631 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:32.032818 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:32.032779 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:32.037484 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:32.037458 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:32.050169 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:32.050120 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:32.050509 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:32.050492 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2vtbs" Jul 06 17:45:32.050910 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:32.050894 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4l6l8c" Jul 06 17:45:57.991604 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:57.991563 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:45:58.219408 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:45:58.219376 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:07.301252 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.301215 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69fb475f8f-rctjl"] Jul 06 17:46:07.309627 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.309600 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.317197 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.317173 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69fb475f8f-rctjl"] Jul 06 17:46:07.351650 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.351614 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-oauth-serving-cert\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.351821 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.351658 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a12ea03f-404f-4342-84c4-d99070692f9b-console-oauth-config\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.351821 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.351684 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-console-config\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.351821 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.351772 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-service-ca\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.351991 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.351823 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-trusted-ca-bundle\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.351991 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.351868 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx5vw\" (UniqueName: \"kubernetes.io/projected/a12ea03f-404f-4342-84c4-d99070692f9b-kube-api-access-wx5vw\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.351991 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.351964 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a12ea03f-404f-4342-84c4-d99070692f9b-console-serving-cert\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.356433 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.356398 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:07.452679 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.452640 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a12ea03f-404f-4342-84c4-d99070692f9b-console-oauth-config\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.452679 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.452679 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-console-config\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.452936 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.452726 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-service-ca\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.452936 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.452746 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-trusted-ca-bundle\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.452936 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.452783 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx5vw\" (UniqueName: \"kubernetes.io/projected/a12ea03f-404f-4342-84c4-d99070692f9b-kube-api-access-wx5vw\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.452936 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.452850 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a12ea03f-404f-4342-84c4-d99070692f9b-console-serving-cert\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.452936 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.452907 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-oauth-serving-cert\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.453512 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.453484 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-console-config\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.453664 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.453528 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-service-ca\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.453757 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.453559 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-oauth-serving-cert\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.453965 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.453946 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a12ea03f-404f-4342-84c4-d99070692f9b-trusted-ca-bundle\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.455278 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.455254 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a12ea03f-404f-4342-84c4-d99070692f9b-console-serving-cert\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.455363 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.455314 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a12ea03f-404f-4342-84c4-d99070692f9b-console-oauth-config\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.464013 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.463995 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx5vw\" (UniqueName: \"kubernetes.io/projected/a12ea03f-404f-4342-84c4-d99070692f9b-kube-api-access-wx5vw\") pod \"console-69fb475f8f-rctjl\" (UID: \"a12ea03f-404f-4342-84c4-d99070692f9b\") " pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.497955 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.497928 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:07.553953 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.553866 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:07.619372 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.619341 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:07.750300 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:07.750275 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69fb475f8f-rctjl"] Jul 06 17:46:07.752752 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:46:07.752724 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda12ea03f_404f_4342_84c4_d99070692f9b.slice/crio-8d60ce09d66557099bdcff9ca01e9ba7f2f8ba0ae404046d8f06a64692633994 WatchSource:0}: Error finding container 8d60ce09d66557099bdcff9ca01e9ba7f2f8ba0ae404046d8f06a64692633994: Status 404 returned error can't find the container with id 8d60ce09d66557099bdcff9ca01e9ba7f2f8ba0ae404046d8f06a64692633994 Jul 06 17:46:08.093070 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:08.092967 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:08.146539 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:08.146511 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:08.217662 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:08.217624 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fb475f8f-rctjl" event={"ID":"a12ea03f-404f-4342-84c4-d99070692f9b","Type":"ContainerStarted","Data":"c86a3b87fdc4be6c9a12fafcbf3a0a0a7565879f606b6d59de31f662caf956b4"} Jul 06 17:46:08.217850 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:08.217679 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69fb475f8f-rctjl" event={"ID":"a12ea03f-404f-4342-84c4-d99070692f9b","Type":"ContainerStarted","Data":"8d60ce09d66557099bdcff9ca01e9ba7f2f8ba0ae404046d8f06a64692633994"} Jul 06 17:46:08.235393 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:08.235346 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69fb475f8f-rctjl" podStartSLOduration=1.2353318309999999 podStartE2EDuration="1.235331831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:46:08.234161194 +0000 UTC m=+438.465406369" watchObservedRunningTime="2026-07-06 17:46:08.235331831 +0000 UTC m=+438.466577006" Jul 06 17:46:17.620416 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:17.620376 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:17.620941 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:17.620448 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:17.625343 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:17.625321 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:18.268984 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:18.268949 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69fb475f8f-rctjl" Jul 06 17:46:18.317236 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:18.317200 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68dd8c8d97-zkgkp"] Jul 06 17:46:18.409258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:18.409218 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:18.463298 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:18.463271 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:18.525648 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:18.525558 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:20.083181 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:20.083149 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:20.176660 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:20.176619 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:20.256733 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:20.256677 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:35.589075 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.589043 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn"] Jul 06 17:46:35.592613 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.592598 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:35.595456 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.595437 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 17:46:35.596521 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.596504 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 17:46:35.596605 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.596506 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lp5dx\"" Jul 06 17:46:35.600320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.600299 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn"] Jul 06 17:46:35.702689 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.702646 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfwb8\" (UniqueName: \"kubernetes.io/projected/e8536547-3f4c-437d-bf1c-cc21958d85ed-kube-api-access-sfwb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:35.702867 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.702772 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:35.702867 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.702794 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:35.803582 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.803549 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:35.803582 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.803584 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:35.803804 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.803608 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfwb8\" (UniqueName: \"kubernetes.io/projected/e8536547-3f4c-437d-bf1c-cc21958d85ed-kube-api-access-sfwb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:35.803971 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.803952 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:35.804018 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.804000 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:35.811551 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.811519 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfwb8\" (UniqueName: \"kubernetes.io/projected/e8536547-3f4c-437d-bf1c-cc21958d85ed-kube-api-access-sfwb8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:35.902411 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:35.902343 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:36.036122 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.036095 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn"] Jul 06 17:46:36.038353 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:46:36.038312 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8536547_3f4c_437d_bf1c_cc21958d85ed.slice/crio-eeba58713c5a43a24af77dc4bb8628fea95d5c3a2a6b1c2c3c39b0ddfcda5910 WatchSource:0}: Error finding container eeba58713c5a43a24af77dc4bb8628fea95d5c3a2a6b1c2c3c39b0ddfcda5910: Status 404 returned error can't find the container with id eeba58713c5a43a24af77dc4bb8628fea95d5c3a2a6b1c2c3c39b0ddfcda5910 Jul 06 17:46:36.347630 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.347599 2539 generic.go:356] "Generic (PLEG): container finished" podID="e8536547-3f4c-437d-bf1c-cc21958d85ed" containerID="ca722bef23326038c30d0fe20de03a2f900c1677935f25f23c15e2d0f81a5799" exitCode=0 Jul 06 17:46:36.347859 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.347693 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" event={"ID":"e8536547-3f4c-437d-bf1c-cc21958d85ed","Type":"ContainerDied","Data":"ca722bef23326038c30d0fe20de03a2f900c1677935f25f23c15e2d0f81a5799"} Jul 06 17:46:36.347859 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.347770 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" event={"ID":"e8536547-3f4c-437d-bf1c-cc21958d85ed","Type":"ContainerStarted","Data":"eeba58713c5a43a24af77dc4bb8628fea95d5c3a2a6b1c2c3c39b0ddfcda5910"} Jul 06 17:46:36.390310 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.390282 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5"] Jul 06 17:46:36.393626 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.393612 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.401512 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.401486 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5"] Jul 06 17:46:36.509571 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.509543 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.509738 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.509590 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7z9f\" (UniqueName: \"kubernetes.io/projected/be654630-64d4-4746-9ca4-ee30c9103e13-kube-api-access-g7z9f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.509792 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.509732 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.610222 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.610151 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.610222 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.610213 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.610582 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.610242 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7z9f\" (UniqueName: \"kubernetes.io/projected/be654630-64d4-4746-9ca4-ee30c9103e13-kube-api-access-g7z9f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.610582 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.610517 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.610582 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.610531 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.619619 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.619592 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7z9f\" (UniqueName: \"kubernetes.io/projected/be654630-64d4-4746-9ca4-ee30c9103e13-kube-api-access-g7z9f\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.702691 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.702659 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:36.830664 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.830640 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5"] Jul 06 17:46:36.832395 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:46:36.832369 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe654630_64d4_4746_9ca4_ee30c9103e13.slice/crio-ea22a7e44d7d403bfbe0581a171f32543c1e28f204225d20ee554d468a7a6752 WatchSource:0}: Error finding container ea22a7e44d7d403bfbe0581a171f32543c1e28f204225d20ee554d468a7a6752: Status 404 returned error can't find the container with id ea22a7e44d7d403bfbe0581a171f32543c1e28f204225d20ee554d468a7a6752 Jul 06 17:46:36.989082 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.989036 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4"] Jul 06 17:46:36.992373 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:36.992357 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.000108 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.000084 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4"] Jul 06 17:46:37.115853 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.115820 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.115992 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.115897 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmsq2\" (UniqueName: \"kubernetes.io/projected/865186d7-6287-487b-9892-998cd51e649e-kube-api-access-mmsq2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.115992 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.115937 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.216798 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.216767 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.216930 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.216842 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.216930 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.216872 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmsq2\" (UniqueName: \"kubernetes.io/projected/865186d7-6287-487b-9892-998cd51e649e-kube-api-access-mmsq2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.217131 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.217114 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.217186 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.217170 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.225545 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.225525 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmsq2\" (UniqueName: \"kubernetes.io/projected/865186d7-6287-487b-9892-998cd51e649e-kube-api-access-mmsq2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.317825 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.317796 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:37.355258 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.355222 2539 generic.go:356] "Generic (PLEG): container finished" podID="e8536547-3f4c-437d-bf1c-cc21958d85ed" containerID="8a1e230a855f5f6c309afdf4e0b9b31bff1d1cf41968cf922a682b7cc2cf108d" exitCode=0 Jul 06 17:46:37.355401 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.355301 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" event={"ID":"e8536547-3f4c-437d-bf1c-cc21958d85ed","Type":"ContainerDied","Data":"8a1e230a855f5f6c309afdf4e0b9b31bff1d1cf41968cf922a682b7cc2cf108d"} Jul 06 17:46:37.358329 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.357239 2539 generic.go:356] "Generic (PLEG): container finished" podID="be654630-64d4-4746-9ca4-ee30c9103e13" containerID="fcb84a4c11b8c44627783998c3b0e157194712edbefafe726d35268a24663a8f" exitCode=0 Jul 06 17:46:37.358329 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.357275 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" event={"ID":"be654630-64d4-4746-9ca4-ee30c9103e13","Type":"ContainerDied","Data":"fcb84a4c11b8c44627783998c3b0e157194712edbefafe726d35268a24663a8f"} Jul 06 17:46:37.358329 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.357313 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" event={"ID":"be654630-64d4-4746-9ca4-ee30c9103e13","Type":"ContainerStarted","Data":"ea22a7e44d7d403bfbe0581a171f32543c1e28f204225d20ee554d468a7a6752"} Jul 06 17:46:37.390530 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.390505 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp"] Jul 06 17:46:37.395207 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.395184 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.404514 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.404484 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp"] Jul 06 17:46:37.459643 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.459615 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4"] Jul 06 17:46:37.462158 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:46:37.462130 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod865186d7_6287_487b_9892_998cd51e649e.slice/crio-1ab67dfdabea8439d1199e515f1eccd38dc732ae656abbb99285896724d3b565 WatchSource:0}: Error finding container 1ab67dfdabea8439d1199e515f1eccd38dc732ae656abbb99285896724d3b565: Status 404 returned error can't find the container with id 1ab67dfdabea8439d1199e515f1eccd38dc732ae656abbb99285896724d3b565 Jul 06 17:46:37.519731 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.519691 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.519832 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.519768 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l7ch\" (UniqueName: \"kubernetes.io/projected/5030c8b4-0341-4d31-8eb3-55a1228279ff-kube-api-access-5l7ch\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.519987 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.519964 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.620795 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.620722 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l7ch\" (UniqueName: \"kubernetes.io/projected/5030c8b4-0341-4d31-8eb3-55a1228279ff-kube-api-access-5l7ch\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.620795 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.620793 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.621184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.620843 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.621184 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.621149 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.621383 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.621184 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.629577 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.629552 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l7ch\" (UniqueName: \"kubernetes.io/projected/5030c8b4-0341-4d31-8eb3-55a1228279ff-kube-api-access-5l7ch\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.714583 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.714539 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:37.848304 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:37.848265 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp"] Jul 06 17:46:37.850340 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:46:37.850312 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5030c8b4_0341_4d31_8eb3_55a1228279ff.slice/crio-19266b6db878d86947e886e85a5acb03ab1f94d7768966cc9eeb28c32dca424a WatchSource:0}: Error finding container 19266b6db878d86947e886e85a5acb03ab1f94d7768966cc9eeb28c32dca424a: Status 404 returned error can't find the container with id 19266b6db878d86947e886e85a5acb03ab1f94d7768966cc9eeb28c32dca424a Jul 06 17:46:38.363587 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:38.363550 2539 generic.go:356] "Generic (PLEG): container finished" podID="e8536547-3f4c-437d-bf1c-cc21958d85ed" containerID="43e2ae8d33027b02d8f723096d9e30d2cad7086c424e6fa582a1d291521aa976" exitCode=0 Jul 06 17:46:38.363900 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:38.363612 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" event={"ID":"e8536547-3f4c-437d-bf1c-cc21958d85ed","Type":"ContainerDied","Data":"43e2ae8d33027b02d8f723096d9e30d2cad7086c424e6fa582a1d291521aa976"} Jul 06 17:46:38.365116 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:38.365097 2539 generic.go:356] "Generic (PLEG): container finished" podID="5030c8b4-0341-4d31-8eb3-55a1228279ff" containerID="845da97a4171f5889298c7e77c9dcfdd544411585c8391afa17eee7424b9de1e" exitCode=0 Jul 06 17:46:38.365212 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:38.365156 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" event={"ID":"5030c8b4-0341-4d31-8eb3-55a1228279ff","Type":"ContainerDied","Data":"845da97a4171f5889298c7e77c9dcfdd544411585c8391afa17eee7424b9de1e"} Jul 06 17:46:38.365212 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:38.365181 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" event={"ID":"5030c8b4-0341-4d31-8eb3-55a1228279ff","Type":"ContainerStarted","Data":"19266b6db878d86947e886e85a5acb03ab1f94d7768966cc9eeb28c32dca424a"} Jul 06 17:46:38.366693 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:38.366670 2539 generic.go:356] "Generic (PLEG): container finished" podID="865186d7-6287-487b-9892-998cd51e649e" containerID="7efbdee313bf01929ac9a0f33bd814be2c8259281a606c394c8919415bafd3a9" exitCode=0 Jul 06 17:46:38.366817 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:38.366726 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" event={"ID":"865186d7-6287-487b-9892-998cd51e649e","Type":"ContainerDied","Data":"7efbdee313bf01929ac9a0f33bd814be2c8259281a606c394c8919415bafd3a9"} Jul 06 17:46:38.366817 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:38.366759 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" event={"ID":"865186d7-6287-487b-9892-998cd51e649e","Type":"ContainerStarted","Data":"1ab67dfdabea8439d1199e515f1eccd38dc732ae656abbb99285896724d3b565"} Jul 06 17:46:38.368880 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:38.368861 2539 generic.go:356] "Generic (PLEG): container finished" podID="be654630-64d4-4746-9ca4-ee30c9103e13" containerID="f323879504fa1b296673c2215dfdbb5f5cbc2e9c782d6bff849171d606af7942" exitCode=0 Jul 06 17:46:38.368967 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:38.368906 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" event={"ID":"be654630-64d4-4746-9ca4-ee30c9103e13","Type":"ContainerDied","Data":"f323879504fa1b296673c2215dfdbb5f5cbc2e9c782d6bff849171d606af7942"} Jul 06 17:46:39.376329 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.376262 2539 generic.go:356] "Generic (PLEG): container finished" podID="be654630-64d4-4746-9ca4-ee30c9103e13" containerID="674d8262d690053822057d7862aa8ed2b6aebb53de45b3b30bd819113dde4925" exitCode=0 Jul 06 17:46:39.376676 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.376348 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" event={"ID":"be654630-64d4-4746-9ca4-ee30c9103e13","Type":"ContainerDied","Data":"674d8262d690053822057d7862aa8ed2b6aebb53de45b3b30bd819113dde4925"} Jul 06 17:46:39.378211 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.378190 2539 generic.go:356] "Generic (PLEG): container finished" podID="5030c8b4-0341-4d31-8eb3-55a1228279ff" containerID="0d7b0bca23b3d781a8ddf072e979ea556d404107f3f3b8bba624fe99f4783c00" exitCode=0 Jul 06 17:46:39.378318 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.378256 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" event={"ID":"5030c8b4-0341-4d31-8eb3-55a1228279ff","Type":"ContainerDied","Data":"0d7b0bca23b3d781a8ddf072e979ea556d404107f3f3b8bba624fe99f4783c00"} Jul 06 17:46:39.380144 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.380126 2539 generic.go:356] "Generic (PLEG): container finished" podID="865186d7-6287-487b-9892-998cd51e649e" containerID="0cc0fd9ff8a832bb4dfbe4a0c0a733ec3bca4ee40be64c8da90e9b31d57fb8d9" exitCode=0 Jul 06 17:46:39.380231 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.380197 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" event={"ID":"865186d7-6287-487b-9892-998cd51e649e","Type":"ContainerDied","Data":"0cc0fd9ff8a832bb4dfbe4a0c0a733ec3bca4ee40be64c8da90e9b31d57fb8d9"} Jul 06 17:46:39.624074 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.624052 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:39.741390 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.741364 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-util\") pod \"e8536547-3f4c-437d-bf1c-cc21958d85ed\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " Jul 06 17:46:39.741562 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.741418 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-bundle\") pod \"e8536547-3f4c-437d-bf1c-cc21958d85ed\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " Jul 06 17:46:39.741562 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.741455 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfwb8\" (UniqueName: \"kubernetes.io/projected/e8536547-3f4c-437d-bf1c-cc21958d85ed-kube-api-access-sfwb8\") pod \"e8536547-3f4c-437d-bf1c-cc21958d85ed\" (UID: \"e8536547-3f4c-437d-bf1c-cc21958d85ed\") " Jul 06 17:46:39.741962 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.741940 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-bundle" (OuterVolumeSpecName: "bundle") pod "e8536547-3f4c-437d-bf1c-cc21958d85ed" (UID: "e8536547-3f4c-437d-bf1c-cc21958d85ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:46:39.743715 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.743677 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8536547-3f4c-437d-bf1c-cc21958d85ed-kube-api-access-sfwb8" (OuterVolumeSpecName: "kube-api-access-sfwb8") pod "e8536547-3f4c-437d-bf1c-cc21958d85ed" (UID: "e8536547-3f4c-437d-bf1c-cc21958d85ed"). InnerVolumeSpecName "kube-api-access-sfwb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:46:39.747296 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.747274 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-util" (OuterVolumeSpecName: "util") pod "e8536547-3f4c-437d-bf1c-cc21958d85ed" (UID: "e8536547-3f4c-437d-bf1c-cc21958d85ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:46:39.842776 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.842752 2539 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-util\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:39.842776 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.842775 2539 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8536547-3f4c-437d-bf1c-cc21958d85ed-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:39.842939 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:39.842783 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfwb8\" (UniqueName: \"kubernetes.io/projected/e8536547-3f4c-437d-bf1c-cc21958d85ed-kube-api-access-sfwb8\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:40.386194 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.386160 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" event={"ID":"e8536547-3f4c-437d-bf1c-cc21958d85ed","Type":"ContainerDied","Data":"eeba58713c5a43a24af77dc4bb8628fea95d5c3a2a6b1c2c3c39b0ddfcda5910"} Jul 06 17:46:40.386566 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.386210 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eeba58713c5a43a24af77dc4bb8628fea95d5c3a2a6b1c2c3c39b0ddfcda5910" Jul 06 17:46:40.386566 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.386176 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn" Jul 06 17:46:40.388396 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.388366 2539 generic.go:356] "Generic (PLEG): container finished" podID="5030c8b4-0341-4d31-8eb3-55a1228279ff" containerID="582e74dca4bdd636b5a0f3e31d354d27400794ae6d42e18dc0f9dae57735c0a1" exitCode=0 Jul 06 17:46:40.388512 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.388423 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" event={"ID":"5030c8b4-0341-4d31-8eb3-55a1228279ff","Type":"ContainerDied","Data":"582e74dca4bdd636b5a0f3e31d354d27400794ae6d42e18dc0f9dae57735c0a1"} Jul 06 17:46:40.390403 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.390381 2539 generic.go:356] "Generic (PLEG): container finished" podID="865186d7-6287-487b-9892-998cd51e649e" containerID="43cdab8793f17162d21b057d7ee3b403062d9931ac58864b11ead56f9a237825" exitCode=0 Jul 06 17:46:40.390488 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.390438 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" event={"ID":"865186d7-6287-487b-9892-998cd51e649e","Type":"ContainerDied","Data":"43cdab8793f17162d21b057d7ee3b403062d9931ac58864b11ead56f9a237825"} Jul 06 17:46:40.523965 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.523940 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:40.648285 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.648205 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7z9f\" (UniqueName: \"kubernetes.io/projected/be654630-64d4-4746-9ca4-ee30c9103e13-kube-api-access-g7z9f\") pod \"be654630-64d4-4746-9ca4-ee30c9103e13\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " Jul 06 17:46:40.648285 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.648262 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-bundle\") pod \"be654630-64d4-4746-9ca4-ee30c9103e13\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " Jul 06 17:46:40.648456 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.648312 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-util\") pod \"be654630-64d4-4746-9ca4-ee30c9103e13\" (UID: \"be654630-64d4-4746-9ca4-ee30c9103e13\") " Jul 06 17:46:40.648788 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.648760 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-bundle" (OuterVolumeSpecName: "bundle") pod "be654630-64d4-4746-9ca4-ee30c9103e13" (UID: "be654630-64d4-4746-9ca4-ee30c9103e13"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:46:40.650468 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.650443 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be654630-64d4-4746-9ca4-ee30c9103e13-kube-api-access-g7z9f" (OuterVolumeSpecName: "kube-api-access-g7z9f") pod "be654630-64d4-4746-9ca4-ee30c9103e13" (UID: "be654630-64d4-4746-9ca4-ee30c9103e13"). InnerVolumeSpecName "kube-api-access-g7z9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:46:40.654266 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.654248 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-util" (OuterVolumeSpecName: "util") pod "be654630-64d4-4746-9ca4-ee30c9103e13" (UID: "be654630-64d4-4746-9ca4-ee30c9103e13"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:46:40.749320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.749285 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7z9f\" (UniqueName: \"kubernetes.io/projected/be654630-64d4-4746-9ca4-ee30c9103e13-kube-api-access-g7z9f\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:40.749320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.749314 2539 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:40.749320 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:40.749323 2539 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be654630-64d4-4746-9ca4-ee30c9103e13-util\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:41.397032 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.396992 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" Jul 06 17:46:41.397414 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.397026 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5" event={"ID":"be654630-64d4-4746-9ca4-ee30c9103e13","Type":"ContainerDied","Data":"ea22a7e44d7d403bfbe0581a171f32543c1e28f204225d20ee554d468a7a6752"} Jul 06 17:46:41.397414 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.397076 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea22a7e44d7d403bfbe0581a171f32543c1e28f204225d20ee554d468a7a6752" Jul 06 17:46:41.556001 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.555980 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:41.558814 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.558797 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:41.655325 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.655248 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-util\") pod \"865186d7-6287-487b-9892-998cd51e649e\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " Jul 06 17:46:41.655325 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.655298 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l7ch\" (UniqueName: \"kubernetes.io/projected/5030c8b4-0341-4d31-8eb3-55a1228279ff-kube-api-access-5l7ch\") pod \"5030c8b4-0341-4d31-8eb3-55a1228279ff\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " Jul 06 17:46:41.655536 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.655347 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-bundle\") pod \"5030c8b4-0341-4d31-8eb3-55a1228279ff\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " Jul 06 17:46:41.655536 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.655361 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-util\") pod \"5030c8b4-0341-4d31-8eb3-55a1228279ff\" (UID: \"5030c8b4-0341-4d31-8eb3-55a1228279ff\") " Jul 06 17:46:41.655536 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.655378 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-bundle\") pod \"865186d7-6287-487b-9892-998cd51e649e\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " Jul 06 17:46:41.655536 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.655403 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmsq2\" (UniqueName: \"kubernetes.io/projected/865186d7-6287-487b-9892-998cd51e649e-kube-api-access-mmsq2\") pod \"865186d7-6287-487b-9892-998cd51e649e\" (UID: \"865186d7-6287-487b-9892-998cd51e649e\") " Jul 06 17:46:41.656035 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.656003 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-bundle" (OuterVolumeSpecName: "bundle") pod "5030c8b4-0341-4d31-8eb3-55a1228279ff" (UID: "5030c8b4-0341-4d31-8eb3-55a1228279ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:46:41.656035 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.656019 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-bundle" (OuterVolumeSpecName: "bundle") pod "865186d7-6287-487b-9892-998cd51e649e" (UID: "865186d7-6287-487b-9892-998cd51e649e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:46:41.657631 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.657612 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5030c8b4-0341-4d31-8eb3-55a1228279ff-kube-api-access-5l7ch" (OuterVolumeSpecName: "kube-api-access-5l7ch") pod "5030c8b4-0341-4d31-8eb3-55a1228279ff" (UID: "5030c8b4-0341-4d31-8eb3-55a1228279ff"). InnerVolumeSpecName "kube-api-access-5l7ch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:46:41.658077 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.658058 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/865186d7-6287-487b-9892-998cd51e649e-kube-api-access-mmsq2" (OuterVolumeSpecName: "kube-api-access-mmsq2") pod "865186d7-6287-487b-9892-998cd51e649e" (UID: "865186d7-6287-487b-9892-998cd51e649e"). InnerVolumeSpecName "kube-api-access-mmsq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:46:41.661833 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.661799 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-util" (OuterVolumeSpecName: "util") pod "5030c8b4-0341-4d31-8eb3-55a1228279ff" (UID: "5030c8b4-0341-4d31-8eb3-55a1228279ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:46:41.663324 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.663300 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-util" (OuterVolumeSpecName: "util") pod "865186d7-6287-487b-9892-998cd51e649e" (UID: "865186d7-6287-487b-9892-998cd51e649e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:46:41.757024 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.756995 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l7ch\" (UniqueName: \"kubernetes.io/projected/5030c8b4-0341-4d31-8eb3-55a1228279ff-kube-api-access-5l7ch\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:41.757024 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.757018 2539 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:41.757024 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.757027 2539 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5030c8b4-0341-4d31-8eb3-55a1228279ff-util\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:41.757203 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.757035 2539 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:41.757203 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.757054 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmsq2\" (UniqueName: \"kubernetes.io/projected/865186d7-6287-487b-9892-998cd51e649e-kube-api-access-mmsq2\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:41.757203 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:41.757063 2539 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/865186d7-6287-487b-9892-998cd51e649e-util\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:42.403337 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:42.403293 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" event={"ID":"5030c8b4-0341-4d31-8eb3-55a1228279ff","Type":"ContainerDied","Data":"19266b6db878d86947e886e85a5acb03ab1f94d7768966cc9eeb28c32dca424a"} Jul 06 17:46:42.403731 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:42.403383 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19266b6db878d86947e886e85a5acb03ab1f94d7768966cc9eeb28c32dca424a" Jul 06 17:46:42.403731 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:42.403315 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp" Jul 06 17:46:42.405483 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:42.405273 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" event={"ID":"865186d7-6287-487b-9892-998cd51e649e","Type":"ContainerDied","Data":"1ab67dfdabea8439d1199e515f1eccd38dc732ae656abbb99285896724d3b565"} Jul 06 17:46:42.405483 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:42.405312 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ab67dfdabea8439d1199e515f1eccd38dc732ae656abbb99285896724d3b565" Jul 06 17:46:42.405483 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:42.405327 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4" Jul 06 17:46:43.340805 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.340766 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68dd8c8d97-zkgkp" podUID="cbd4ffbd-d51c-402b-ac68-93970e118582" containerName="console" containerID="cri-o://197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df" gracePeriod=15 Jul 06 17:46:43.600929 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.600872 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:46:43.775397 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.775362 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-console-config\") pod \"cbd4ffbd-d51c-402b-ac68-93970e118582\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " Jul 06 17:46:43.775552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.775416 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjlnc\" (UniqueName: \"kubernetes.io/projected/cbd4ffbd-d51c-402b-ac68-93970e118582-kube-api-access-wjlnc\") pod \"cbd4ffbd-d51c-402b-ac68-93970e118582\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " Jul 06 17:46:43.775552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.775454 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-trusted-ca-bundle\") pod \"cbd4ffbd-d51c-402b-ac68-93970e118582\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " Jul 06 17:46:43.775552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.775471 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-service-ca\") pod \"cbd4ffbd-d51c-402b-ac68-93970e118582\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " Jul 06 17:46:43.775552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.775485 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-oauth-serving-cert\") pod \"cbd4ffbd-d51c-402b-ac68-93970e118582\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " Jul 06 17:46:43.775552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.775502 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-serving-cert\") pod \"cbd4ffbd-d51c-402b-ac68-93970e118582\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " Jul 06 17:46:43.775552 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.775535 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-oauth-config\") pod \"cbd4ffbd-d51c-402b-ac68-93970e118582\" (UID: \"cbd4ffbd-d51c-402b-ac68-93970e118582\") " Jul 06 17:46:43.775861 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.775810 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-console-config" (OuterVolumeSpecName: "console-config") pod "cbd4ffbd-d51c-402b-ac68-93970e118582" (UID: "cbd4ffbd-d51c-402b-ac68-93970e118582"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:46:43.775978 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.775958 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cbd4ffbd-d51c-402b-ac68-93970e118582" (UID: "cbd4ffbd-d51c-402b-ac68-93970e118582"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:46:43.776068 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.776042 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cbd4ffbd-d51c-402b-ac68-93970e118582" (UID: "cbd4ffbd-d51c-402b-ac68-93970e118582"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:46:43.776120 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.776045 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-service-ca" (OuterVolumeSpecName: "service-ca") pod "cbd4ffbd-d51c-402b-ac68-93970e118582" (UID: "cbd4ffbd-d51c-402b-ac68-93970e118582"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:46:43.778023 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.777994 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cbd4ffbd-d51c-402b-ac68-93970e118582" (UID: "cbd4ffbd-d51c-402b-ac68-93970e118582"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:46:43.778128 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.778063 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbd4ffbd-d51c-402b-ac68-93970e118582-kube-api-access-wjlnc" (OuterVolumeSpecName: "kube-api-access-wjlnc") pod "cbd4ffbd-d51c-402b-ac68-93970e118582" (UID: "cbd4ffbd-d51c-402b-ac68-93970e118582"). InnerVolumeSpecName "kube-api-access-wjlnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:46:43.778128 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.778086 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cbd4ffbd-d51c-402b-ac68-93970e118582" (UID: "cbd4ffbd-d51c-402b-ac68-93970e118582"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 17:46:43.876571 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.876484 2539 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-trusted-ca-bundle\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:43.876571 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.876524 2539 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-service-ca\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:43.876571 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.876534 2539 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-oauth-serving-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:43.876571 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.876544 2539 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-serving-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:43.876571 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.876552 2539 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cbd4ffbd-d51c-402b-ac68-93970e118582-console-oauth-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:43.876571 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.876560 2539 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cbd4ffbd-d51c-402b-ac68-93970e118582-console-config\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:43.876571 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:43.876568 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjlnc\" (UniqueName: \"kubernetes.io/projected/cbd4ffbd-d51c-402b-ac68-93970e118582-kube-api-access-wjlnc\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 17:46:44.164764 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.164676 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:44.214447 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.214406 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:44.417309 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.417219 2539 generic.go:356] "Generic (PLEG): container finished" podID="cbd4ffbd-d51c-402b-ac68-93970e118582" containerID="197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df" exitCode=0 Jul 06 17:46:44.417309 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.417269 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dd8c8d97-zkgkp" Jul 06 17:46:44.417530 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.417317 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dd8c8d97-zkgkp" event={"ID":"cbd4ffbd-d51c-402b-ac68-93970e118582","Type":"ContainerDied","Data":"197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df"} Jul 06 17:46:44.417530 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.417371 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dd8c8d97-zkgkp" event={"ID":"cbd4ffbd-d51c-402b-ac68-93970e118582","Type":"ContainerDied","Data":"31751d6b6ff63ef56f81faf652bcbbdbfbb0093924aa7b7499500c6a540163ad"} Jul 06 17:46:44.417530 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.417398 2539 scope.go:117] "RemoveContainer" containerID="197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df" Jul 06 17:46:44.426138 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.426119 2539 scope.go:117] "RemoveContainer" containerID="197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df" Jul 06 17:46:44.426406 ip-10-0-137-203 kubenswrapper[2539]: E0706 17:46:44.426386 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df\": container with ID starting with 197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df not found: ID does not exist" containerID="197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df" Jul 06 17:46:44.426455 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.426415 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df"} err="failed to get container status \"197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df\": rpc error: code = NotFound desc = could not find container \"197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df\": container with ID starting with 197f0518b64f843ca74ffc6f74d1114085cd58504536b1a3b572051e6b7697df not found: ID does not exist" Jul 06 17:46:44.435570 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.435545 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68dd8c8d97-zkgkp"] Jul 06 17:46:44.439328 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:44.439309 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68dd8c8d97-zkgkp"] Jul 06 17:46:46.303562 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:46.303529 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbd4ffbd-d51c-402b-ac68-93970e118582" path="/var/lib/kubelet/pods/cbd4ffbd-d51c-402b-ac68-93970e118582/volumes" Jul 06 17:46:49.387003 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:49.386969 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:53.564432 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:53.564390 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:56.019599 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:56.019566 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:56.194982 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:56.194932 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:46:57.416668 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:46:57.416630 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:00.563365 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:00.563331 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:00.990261 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:00.990200 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:01.247125 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:01.247035 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:01.373109 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:01.373058 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:04.025086 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:04.025048 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:05.847169 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:05.847138 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:05.961569 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:05.961534 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:09.606147 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:09.606098 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:09.711582 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:09.711549 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:10.248874 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:10.248841 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:10.417055 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:10.416994 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:12.977442 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:12.977404 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:13.077197 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:13.077159 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:14.288902 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:14.288857 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:21.431141 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:21.431084 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:21.518868 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:21.518833 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:23.900092 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:23.900060 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:24.001665 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:24.001625 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:26.776662 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:26.776626 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:26.881161 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:26.881128 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:30.276207 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:30.276170 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:30.377969 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:30.377927 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:39.131408 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:39.131361 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:39.231534 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:39.231505 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:41.698879 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:41.698797 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:41.824447 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:41.824410 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:44.898121 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:44.898084 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:45.000034 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:44.999971 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:48.304814 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:48.304783 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:48.365501 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:48.365472 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:49.706970 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.706940 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg"] Jul 06 17:47:49.707331 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707273 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5030c8b4-0341-4d31-8eb3-55a1228279ff" containerName="util" Jul 06 17:47:49.707331 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707285 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="5030c8b4-0341-4d31-8eb3-55a1228279ff" containerName="util" Jul 06 17:47:49.707331 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707294 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5030c8b4-0341-4d31-8eb3-55a1228279ff" containerName="pull" Jul 06 17:47:49.707331 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707300 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="5030c8b4-0341-4d31-8eb3-55a1228279ff" containerName="pull" Jul 06 17:47:49.707331 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707307 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be654630-64d4-4746-9ca4-ee30c9103e13" containerName="extract" Jul 06 17:47:49.707331 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707312 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="be654630-64d4-4746-9ca4-ee30c9103e13" containerName="extract" Jul 06 17:47:49.707331 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707320 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be654630-64d4-4746-9ca4-ee30c9103e13" containerName="util" Jul 06 17:47:49.707331 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707325 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="be654630-64d4-4746-9ca4-ee30c9103e13" containerName="util" Jul 06 17:47:49.707331 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707334 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8536547-3f4c-437d-bf1c-cc21958d85ed" containerName="pull" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707341 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8536547-3f4c-437d-bf1c-cc21958d85ed" containerName="pull" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707346 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865186d7-6287-487b-9892-998cd51e649e" containerName="extract" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707351 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="865186d7-6287-487b-9892-998cd51e649e" containerName="extract" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707358 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8536547-3f4c-437d-bf1c-cc21958d85ed" containerName="util" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707362 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8536547-3f4c-437d-bf1c-cc21958d85ed" containerName="util" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707369 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5030c8b4-0341-4d31-8eb3-55a1228279ff" containerName="extract" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707374 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="5030c8b4-0341-4d31-8eb3-55a1228279ff" containerName="extract" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707381 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8536547-3f4c-437d-bf1c-cc21958d85ed" containerName="extract" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707385 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8536547-3f4c-437d-bf1c-cc21958d85ed" containerName="extract" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707395 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865186d7-6287-487b-9892-998cd51e649e" containerName="util" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707400 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="865186d7-6287-487b-9892-998cd51e649e" containerName="util" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707405 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="865186d7-6287-487b-9892-998cd51e649e" containerName="pull" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707410 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="865186d7-6287-487b-9892-998cd51e649e" containerName="pull" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707417 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be654630-64d4-4746-9ca4-ee30c9103e13" containerName="pull" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707422 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="be654630-64d4-4746-9ca4-ee30c9103e13" containerName="pull" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707429 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbd4ffbd-d51c-402b-ac68-93970e118582" containerName="console" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707434 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbd4ffbd-d51c-402b-ac68-93970e118582" containerName="console" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707479 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="be654630-64d4-4746-9ca4-ee30c9103e13" containerName="extract" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707485 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="865186d7-6287-487b-9892-998cd51e649e" containerName="extract" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707493 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8536547-3f4c-437d-bf1c-cc21958d85ed" containerName="extract" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707498 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="5030c8b4-0341-4d31-8eb3-55a1228279ff" containerName="extract" Jul 06 17:47:49.707625 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.707504 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbd4ffbd-d51c-402b-ac68-93970e118582" containerName="console" Jul 06 17:47:49.710029 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.710013 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.712559 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.712538 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-l4kzh\"" Jul 06 17:47:49.720618 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.720597 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg"] Jul 06 17:47:49.731136 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.731108 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:49.851460 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.851430 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.851620 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.851478 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.851620 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.851556 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.851620 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.851573 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7abc9186-7495-4fe2-a67b-60044ed70c69-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.851620 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.851599 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.851808 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.851642 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.851808 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.851665 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.851808 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.851686 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj4t2\" (UniqueName: \"kubernetes.io/projected/7abc9186-7495-4fe2-a67b-60044ed70c69-kube-api-access-mj4t2\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.851808 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.851728 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.941998 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.941962 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:49.953163 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953139 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953304 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953168 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953304 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953196 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj4t2\" (UniqueName: \"kubernetes.io/projected/7abc9186-7495-4fe2-a67b-60044ed70c69-kube-api-access-mj4t2\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953304 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953219 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953304 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953242 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953304 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953281 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953589 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953382 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953589 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953415 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7abc9186-7495-4fe2-a67b-60044ed70c69-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953589 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953446 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953820 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953604 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953820 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953663 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953820 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953769 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.953820 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.953810 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.954090 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.954074 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7abc9186-7495-4fe2-a67b-60044ed70c69-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.955624 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.955597 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.955938 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.955919 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.961126 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.961078 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7abc9186-7495-4fe2-a67b-60044ed70c69-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:49.961974 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:49.961954 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj4t2\" (UniqueName: \"kubernetes.io/projected/7abc9186-7495-4fe2-a67b-60044ed70c69-kube-api-access-mj4t2\") pod \"maas-default-gateway-openshift-default-56654dcf7-wzgdg\" (UID: \"7abc9186-7495-4fe2-a67b-60044ed70c69\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:50.020968 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:50.020935 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:50.157159 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:50.157132 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg"] Jul 06 17:47:50.159015 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:47:50.158988 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7abc9186_7495_4fe2_a67b_60044ed70c69.slice/crio-86d82ab10dae5ffd930392cbf62a9db48e72799d8002efd66efb8270f4fb09dc WatchSource:0}: Error finding container 86d82ab10dae5ffd930392cbf62a9db48e72799d8002efd66efb8270f4fb09dc: Status 404 returned error can't find the container with id 86d82ab10dae5ffd930392cbf62a9db48e72799d8002efd66efb8270f4fb09dc Jul 06 17:47:50.161137 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:50.161109 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:47:50.161239 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:50.161173 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:47:50.161239 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:50.161199 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:47:50.742072 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:50.742039 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" event={"ID":"7abc9186-7495-4fe2-a67b-60044ed70c69","Type":"ContainerStarted","Data":"5a120cdad09ded27b91ec7e88908ae35d284582e3a487431f1e96b43d586574c"} Jul 06 17:47:50.742492 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:50.742095 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" event={"ID":"7abc9186-7495-4fe2-a67b-60044ed70c69","Type":"ContainerStarted","Data":"86d82ab10dae5ffd930392cbf62a9db48e72799d8002efd66efb8270f4fb09dc"} Jul 06 17:47:50.765100 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:50.765056 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" podStartSLOduration=1.7650421139999999 podStartE2EDuration="1.765042114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:47:50.762984315 +0000 UTC m=+540.994229491" watchObservedRunningTime="2026-07-06 17:47:50.765042114 +0000 UTC m=+540.996287288" Jul 06 17:47:51.021549 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:51.021473 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:51.026442 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:51.026420 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:51.671722 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:51.671664 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:51.747684 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:51.747658 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:51.748648 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:51.748632 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:47:51.773078 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:51.773049 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:56.899737 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:56.899683 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:47:56.998773 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:47:56.998734 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:09.106978 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:09.106941 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:09.213665 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:09.213629 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:09.276706 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:09.276678 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:09.925968 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:09.925929 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:09.983575 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:09.983534 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:12.197348 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:12.197307 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:28.764569 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:28.764538 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:40.897502 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:40.897462 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:41.141241 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:41.141186 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:46.945472 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:46.945431 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:47.042930 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:47.042895 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:47.099200 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:47.099164 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:50.166191 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:50.166158 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:48:50.166728 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:50.166693 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:48:50.432522 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:50.432479 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:48:50.529264 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:48:50.529229 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:22.383382 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:22.383339 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:22.915780 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:22.915743 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:23.123651 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:23.123601 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:23.355104 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:23.355075 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:23.425016 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:23.424976 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:23.785875 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:23.785841 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:31.239318 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:31.239284 2539 generic.go:356] "Generic (PLEG): container finished" podID="7abc9186-7495-4fe2-a67b-60044ed70c69" containerID="5a120cdad09ded27b91ec7e88908ae35d284582e3a487431f1e96b43d586574c" exitCode=0 Jul 06 17:49:31.239878 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:31.239368 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" event={"ID":"7abc9186-7495-4fe2-a67b-60044ed70c69","Type":"ContainerDied","Data":"5a120cdad09ded27b91ec7e88908ae35d284582e3a487431f1e96b43d586574c"} Jul 06 17:49:31.239972 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:31.239908 2539 scope.go:117] "RemoveContainer" containerID="5a120cdad09ded27b91ec7e88908ae35d284582e3a487431f1e96b43d586574c" Jul 06 17:49:31.240914 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:31.240890 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:49:31.241029 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:31.240954 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:49:31.241029 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:31.240988 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:49:32.246052 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:32.246017 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" event={"ID":"7abc9186-7495-4fe2-a67b-60044ed70c69","Type":"ContainerStarted","Data":"6bbb35e77d920b12983bcfb05eb50fa8da57957c1f939be8f4a76a2ea5ea4256"} Jul 06 17:49:33.022112 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:33.022075 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:49:33.023124 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:33.023098 2539 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wzgdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 06 17:49:33.023263 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:33.023152 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" podUID="7abc9186-7495-4fe2-a67b-60044ed70c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 06 17:49:33.270750 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:33.270692 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:33.369690 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:33.369595 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:34.022207 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:34.022171 2539 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wzgdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 06 17:49:34.022388 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:34.022223 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" podUID="7abc9186-7495-4fe2-a67b-60044ed70c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 06 17:49:35.021722 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:35.021661 2539 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-wzgdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body= Jul 06 17:49:35.022123 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:35.021764 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" podUID="7abc9186-7495-4fe2-a67b-60044ed70c69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" Jul 06 17:49:36.025221 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:36.025192 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:49:36.025602 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:36.025460 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:49:36.026241 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:36.026218 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-wzgdg" Jul 06 17:49:44.918549 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:44.918512 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:46.012127 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:46.012079 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:47.958496 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:47.958456 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:48.058182 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:48.058153 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:59.476649 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.476617 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25"] Jul 06 17:49:59.480207 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.480188 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.482950 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.482904 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hkwh9\"" Jul 06 17:49:59.482950 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.482922 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 17:49:59.483108 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.483004 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 17:49:59.484166 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.484149 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 17:49:59.491827 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.491807 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25"] Jul 06 17:49:59.519366 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.519322 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:49:59.646640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.646604 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7t5l\" (UniqueName: \"kubernetes.io/projected/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-kube-api-access-c7t5l\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.646640 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.646646 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.646880 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.646680 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.646880 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.646763 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.646880 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.646819 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.646880 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.646845 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.753981 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.753911 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.754162 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.754141 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.754203 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.754171 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.754255 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.754221 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7t5l\" (UniqueName: \"kubernetes.io/projected/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-kube-api-access-c7t5l\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.754307 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.754283 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.754376 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.754359 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.754572 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.754549 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.754645 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.754605 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.754736 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.754690 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.756452 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.756429 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.756743 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.756722 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.762476 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.762454 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7t5l\" (UniqueName: \"kubernetes.io/projected/2011d1a9-a5d1-4965-91e3-e855d46ed4a5-kube-api-access-c7t5l\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tsc25\" (UID: \"2011d1a9-a5d1-4965-91e3-e855d46ed4a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.791482 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.791457 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:49:59.923172 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.923147 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25"] Jul 06 17:49:59.925211 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:49:59.925180 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2011d1a9_a5d1_4965_91e3_e855d46ed4a5.slice/crio-f7e77a80134718fd235f72b0d169ac6818826bfbf602f755c5394dadda12cf8e WatchSource:0}: Error finding container f7e77a80134718fd235f72b0d169ac6818826bfbf602f755c5394dadda12cf8e: Status 404 returned error can't find the container with id f7e77a80134718fd235f72b0d169ac6818826bfbf602f755c5394dadda12cf8e Jul 06 17:49:59.926663 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:49:59.926642 2539 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:50:00.381629 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:00.381591 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" event={"ID":"2011d1a9-a5d1-4965-91e3-e855d46ed4a5","Type":"ContainerStarted","Data":"f7e77a80134718fd235f72b0d169ac6818826bfbf602f755c5394dadda12cf8e"} Jul 06 17:50:01.388638 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:01.388545 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" event={"ID":"2011d1a9-a5d1-4965-91e3-e855d46ed4a5","Type":"ContainerStarted","Data":"e82c47bae5882b02a532b61618c2dfc2b753f0367c06be514d3cccee47fdbb57"} Jul 06 17:50:01.406986 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:01.406932 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" podStartSLOduration=1.291228564 podStartE2EDuration="2.406915298s" totalImagesPullingTime="1.115686734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:50:01.404438424 +0000 UTC m=+671.635683599" watchObservedRunningTime="2026-07-06 17:50:01.406915298 +0000 UTC m=+671.638160473" Jul 06 17:50:09.791790 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:09.791752 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:50:09.792215 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:09.791818 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:50:09.804325 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:09.804297 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:50:10.202927 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:10.202889 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:10.445341 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:10.445310 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tsc25" Jul 06 17:50:22.612810 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:22.612754 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:29.484319 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.484285 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp"] Jul 06 17:50:29.488534 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.488519 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.490922 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.490902 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 06 17:50:29.495810 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.495656 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp"] Jul 06 17:50:29.590275 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.590240 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:29.614310 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.614270 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.614310 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.614314 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.614484 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.614406 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.614484 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.614426 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfphz\" (UniqueName: \"kubernetes.io/projected/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-kube-api-access-bfphz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.614484 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.614444 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.614484 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.614478 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.715830 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.715793 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.715830 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.715829 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfphz\" (UniqueName: \"kubernetes.io/projected/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-kube-api-access-bfphz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.716074 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.715858 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.716074 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.716058 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.716190 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.716114 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.716190 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.716151 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.716297 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.716265 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.716416 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.716396 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.716530 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.716512 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.718333 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.718313 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.718578 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.718561 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.723228 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.723206 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfphz\" (UniqueName: \"kubernetes.io/projected/cfb4dafc-ce8d-4977-bbe5-7daff8d8415e-kube-api-access-bfphz\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-th4jp\" (UID: \"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.799732 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.799635 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:29.931011 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:29.930988 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp"] Jul 06 17:50:29.932820 ip-10-0-137-203 kubenswrapper[2539]: W0706 17:50:29.932778 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb4dafc_ce8d_4977_bbe5_7daff8d8415e.slice/crio-890aa3c11b889ed632c125efdc1b7dddd2fc72532143e52db32a57003534e2ff WatchSource:0}: Error finding container 890aa3c11b889ed632c125efdc1b7dddd2fc72532143e52db32a57003534e2ff: Status 404 returned error can't find the container with id 890aa3c11b889ed632c125efdc1b7dddd2fc72532143e52db32a57003534e2ff Jul 06 17:50:30.131750 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:30.131658 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:30.232580 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:30.232552 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:30.529656 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:30.529614 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" event={"ID":"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e","Type":"ContainerStarted","Data":"b53558f649b2b23a1f91143f7ea4c71ff896d1e6160b24cbd2a28ea77c055dfb"} Jul 06 17:50:30.530038 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:30.529666 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" event={"ID":"cfb4dafc-ce8d-4977-bbe5-7daff8d8415e","Type":"ContainerStarted","Data":"890aa3c11b889ed632c125efdc1b7dddd2fc72532143e52db32a57003534e2ff"} Jul 06 17:50:30.545870 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:30.545827 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" podStartSLOduration=1.336678058 podStartE2EDuration="1.545814331s" totalImagesPullingTime="209.136273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:50:30.545241156 +0000 UTC m=+700.776486330" watchObservedRunningTime="2026-07-06 17:50:30.545814331 +0000 UTC m=+700.777059505" Jul 06 17:50:31.233897 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:31.233837 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:31.334524 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:31.334479 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:39.024615 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:39.024580 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:50:39.800827 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:39.800788 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:39.801016 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:39.800868 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:39.813447 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:39.813419 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:40.589340 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:40.589274 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-th4jp" Jul 06 17:50:44.142943 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:50:44.142902 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:44.034482 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:51:44.034446 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:44.127324 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:51:44.127282 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:45.161890 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:51:45.161812 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:51:45.268381 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:51:45.268345 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:56.244185 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:52:56.244153 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:52:57.485937 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:52:57.485895 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:38.118644 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:38.118612 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:38.217436 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:38.217404 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:38.328164 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:38.328134 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:43.964869 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:43.964780 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:44.021037 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:44.021004 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:44.096645 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:44.096611 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:44.195275 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:44.195242 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:44.328408 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:44.328331 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:49.849157 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:49.849122 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:49.906626 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:49.906575 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:53:50.197687 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:50.197659 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:53:50.199146 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:53:50.199125 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:54:34.231583 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:54:34.231546 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:56:07.914284 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:56:07.914250 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:58:50.229445 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:58:50.229419 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:58:50.231149 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:58:50.231134 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 17:59:03.289753 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:59:03.289709 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:59:03.343151 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:59:03.343118 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:59:06.821869 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:59:06.821781 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 17:59:06.922661 ip-10-0-137-203 kubenswrapper[2539]: I0706 17:59:06.922627 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:00:00.141311 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:00.141215 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722680-5b7sc"] Jul 06 18:00:00.144788 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:00.144768 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" Jul 06 18:00:00.147304 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:00.147285 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-z2cpm\"" Jul 06 18:00:00.151610 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:00.151584 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722680-5b7sc"] Jul 06 18:00:00.263792 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:00.263754 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z898r\" (UniqueName: \"kubernetes.io/projected/da27fe33-3204-4ff2-b884-34c4903f6919-kube-api-access-z898r\") pod \"maas-api-key-cleanup-29722680-5b7sc\" (UID: \"da27fe33-3204-4ff2-b884-34c4903f6919\") " pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" Jul 06 18:00:00.364557 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:00.364513 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z898r\" (UniqueName: \"kubernetes.io/projected/da27fe33-3204-4ff2-b884-34c4903f6919-kube-api-access-z898r\") pod \"maas-api-key-cleanup-29722680-5b7sc\" (UID: \"da27fe33-3204-4ff2-b884-34c4903f6919\") " pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" Jul 06 18:00:00.373054 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:00.373023 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z898r\" (UniqueName: \"kubernetes.io/projected/da27fe33-3204-4ff2-b884-34c4903f6919-kube-api-access-z898r\") pod \"maas-api-key-cleanup-29722680-5b7sc\" (UID: \"da27fe33-3204-4ff2-b884-34c4903f6919\") " pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" Jul 06 18:00:00.455668 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:00.455637 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" Jul 06 18:00:00.795853 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:00.795824 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722680-5b7sc"] Jul 06 18:00:00.797583 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:00:00.797552 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda27fe33_3204_4ff2_b884_34c4903f6919.slice/crio-79afb662d12829ebb62cc13f2e3ca14685744fc51e4e342fed41343b130158c8 WatchSource:0}: Error finding container 79afb662d12829ebb62cc13f2e3ca14685744fc51e4e342fed41343b130158c8: Status 404 returned error can't find the container with id 79afb662d12829ebb62cc13f2e3ca14685744fc51e4e342fed41343b130158c8 Jul 06 18:00:00.799524 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:00.799509 2539 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 18:00:01.309796 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:01.309759 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" event={"ID":"da27fe33-3204-4ff2-b884-34c4903f6919","Type":"ContainerStarted","Data":"79afb662d12829ebb62cc13f2e3ca14685744fc51e4e342fed41343b130158c8"} Jul 06 18:00:06.335194 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:06.335156 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" event={"ID":"da27fe33-3204-4ff2-b884-34c4903f6919","Type":"ContainerStarted","Data":"f1420742f94a38b056ebc554c48c9f5b1dcc8f13fbc572b26d8e268a7769f0d8"} Jul 06 18:00:06.352020 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:06.351973 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" podStartSLOduration=1.2533222880000001 podStartE2EDuration="6.351958043s" totalImagesPullingTime="5.098635755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:00:06.350122966 +0000 UTC m=+1276.581368141" watchObservedRunningTime="2026-07-06 18:00:06.351958043 +0000 UTC m=+1276.583203218" Jul 06 18:00:07.341714 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:07.341666 2539 generic.go:356] "Generic (PLEG): container finished" podID="da27fe33-3204-4ff2-b884-34c4903f6919" containerID="f1420742f94a38b056ebc554c48c9f5b1dcc8f13fbc572b26d8e268a7769f0d8" exitCode=0 Jul 06 18:00:07.342084 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:07.341757 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" event={"ID":"da27fe33-3204-4ff2-b884-34c4903f6919","Type":"ContainerDied","Data":"f1420742f94a38b056ebc554c48c9f5b1dcc8f13fbc572b26d8e268a7769f0d8"} Jul 06 18:00:08.473279 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:08.473256 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" Jul 06 18:00:08.539979 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:08.539947 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z898r\" (UniqueName: \"kubernetes.io/projected/da27fe33-3204-4ff2-b884-34c4903f6919-kube-api-access-z898r\") pod \"da27fe33-3204-4ff2-b884-34c4903f6919\" (UID: \"da27fe33-3204-4ff2-b884-34c4903f6919\") " Jul 06 18:00:08.542098 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:08.542073 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da27fe33-3204-4ff2-b884-34c4903f6919-kube-api-access-z898r" (OuterVolumeSpecName: "kube-api-access-z898r") pod "da27fe33-3204-4ff2-b884-34c4903f6919" (UID: "da27fe33-3204-4ff2-b884-34c4903f6919"). InnerVolumeSpecName "kube-api-access-z898r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:00:08.641234 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:08.641173 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z898r\" (UniqueName: \"kubernetes.io/projected/da27fe33-3204-4ff2-b884-34c4903f6919-kube-api-access-z898r\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:00:09.351672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:09.351635 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" event={"ID":"da27fe33-3204-4ff2-b884-34c4903f6919","Type":"ContainerDied","Data":"79afb662d12829ebb62cc13f2e3ca14685744fc51e4e342fed41343b130158c8"} Jul 06 18:00:09.351672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:09.351665 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722680-5b7sc" Jul 06 18:00:09.351890 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:09.351687 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79afb662d12829ebb62cc13f2e3ca14685744fc51e4e342fed41343b130158c8" Jul 06 18:00:29.697094 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:29.697054 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:00:29.749120 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:00:29.749080 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:02:19.232043 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:02:19.232003 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:03:50.260379 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:03:50.260350 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 18:03:50.263295 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:03:50.263275 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 18:04:37.739773 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:04:37.739737 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:04:44.365738 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:04:44.365682 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:04:52.630468 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:04:52.630435 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:04:57.939613 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:04:57.939582 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:00.594424 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:00.594394 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:00.697160 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:00.697128 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:01.284071 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:01.284038 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:06.715871 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:06.715840 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:06.773845 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:06.773815 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:06.911384 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:06.911344 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk"] Jul 06 18:05:06.911758 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:06.911742 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da27fe33-3204-4ff2-b884-34c4903f6919" containerName="cleanup" Jul 06 18:05:06.911817 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:06.911761 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="da27fe33-3204-4ff2-b884-34c4903f6919" containerName="cleanup" Jul 06 18:05:06.911854 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:06.911825 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="da27fe33-3204-4ff2-b884-34c4903f6919" containerName="cleanup" Jul 06 18:05:06.914940 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:06.914914 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:06.917834 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:06.917816 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2d5b0cda-openshift-default-dockercfg-2qwlj\"" Jul 06 18:05:06.933212 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:06.933187 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk"] Jul 06 18:05:06.936787 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:06.936768 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:07.012986 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.012901 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f9l2\" (UniqueName: \"kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-kube-api-access-2f9l2\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.013149 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.013095 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-certs\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.013219 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.013184 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-podinfo\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.013281 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.013249 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istiod-ca-cert\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.013336 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.013287 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-socket\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.013336 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.013325 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-envoy\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.013440 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.013353 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-credential-socket\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.013440 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.013387 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-token\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.013531 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.013446 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-data\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.034344 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.034311 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:07.114090 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114061 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9l2\" (UniqueName: \"kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-kube-api-access-2f9l2\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114222 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114110 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-certs\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114222 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114158 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-podinfo\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114222 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114181 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istiod-ca-cert\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114222 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114209 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-socket\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114432 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114239 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-envoy\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114432 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114261 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-credential-socket\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114432 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114307 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-token\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114432 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114366 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-data\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114623 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114591 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-certs\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114680 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114628 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-socket\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114772 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114726 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-credential-socket\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114831 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114786 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-data\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.114943 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.114923 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istiod-ca-cert\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.116565 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.116545 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-envoy\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.117064 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.117045 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-podinfo\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.122229 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.122204 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f9l2\" (UniqueName: \"kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-kube-api-access-2f9l2\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.122636 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.122618 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-token\") pod \"e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.227519 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.227498 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:07.361097 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.361070 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk"] Jul 06 18:05:07.362885 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:05:07.362845 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6edf1e29_4b38_40a1_b4ee_836ed8fc670c.slice/crio-2e40b556f02926576998dae5ffcd7586a87b3d52d39a6fac4bf0176901a4baef WatchSource:0}: Error finding container 2e40b556f02926576998dae5ffcd7586a87b3d52d39a6fac4bf0176901a4baef: Status 404 returned error can't find the container with id 2e40b556f02926576998dae5ffcd7586a87b3d52d39a6fac4bf0176901a4baef Jul 06 18:05:07.365027 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.364994 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:05:07.365096 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.365062 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:05:07.365133 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.365110 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:05:07.816412 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.816372 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" event={"ID":"6edf1e29-4b38-40a1-b4ee-836ed8fc670c","Type":"ContainerStarted","Data":"d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa"} Jul 06 18:05:07.816906 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.816429 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" event={"ID":"6edf1e29-4b38-40a1-b4ee-836ed8fc670c","Type":"ContainerStarted","Data":"2e40b556f02926576998dae5ffcd7586a87b3d52d39a6fac4bf0176901a4baef"} Jul 06 18:05:07.836578 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:07.836535 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" podStartSLOduration=1.836521219 podStartE2EDuration="1.836521219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:05:07.835460731 +0000 UTC m=+1578.066705930" watchObservedRunningTime="2026-07-06 18:05:07.836521219 +0000 UTC m=+1578.067766394" Jul 06 18:05:08.028882 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:08.028844 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:08.227649 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:08.227619 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:08.232463 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:08.232437 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:08.379124 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:08.379091 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:08.461101 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:08.461073 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:08.716879 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:08.716847 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:08.817303 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:08.817251 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:08.821048 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:08.821030 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:08.822057 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:08.822039 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:10.799275 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:10.799243 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:13.180792 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:13.180760 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:13.396328 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:13.396290 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk"] Jul 06 18:05:13.396548 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:13.396512 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" podUID="6edf1e29-4b38-40a1-b4ee-836ed8fc670c" containerName="istio-proxy" containerID="cri-o://d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa" gracePeriod=30 Jul 06 18:05:13.421367 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:13.421342 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:13.518009 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:13.517934 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:13.658633 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:13.658606 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:15.303729 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:15.292864 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:19.129546 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.129511 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:19.229532 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.229504 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:19.297419 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.297384 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5"] Jul 06 18:05:19.300516 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.300479 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.303210 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.303191 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ad92259c-openshift-default-dockercfg-ktxps\"" Jul 06 18:05:19.314908 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.314886 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5"] Jul 06 18:05:19.339985 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.339962 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:19.350962 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.350943 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:19.418967 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.418851 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-token\") pod \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " Jul 06 18:05:19.418967 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.418941 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-socket\") pod \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " Jul 06 18:05:19.419241 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.418989 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istiod-ca-cert\") pod \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " Jul 06 18:05:19.419241 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419029 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f9l2\" (UniqueName: \"kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-kube-api-access-2f9l2\") pod \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " Jul 06 18:05:19.419241 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419088 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-credential-socket\") pod \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " Jul 06 18:05:19.419241 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419154 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-envoy\") pod \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " Jul 06 18:05:19.419241 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419185 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-podinfo\") pod \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " Jul 06 18:05:19.419241 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419214 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-certs\") pod \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " Jul 06 18:05:19.419241 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419226 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6edf1e29-4b38-40a1-b4ee-836ed8fc670c" (UID: "6edf1e29-4b38-40a1-b4ee-836ed8fc670c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:19.419672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419251 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-data\") pod \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\" (UID: \"6edf1e29-4b38-40a1-b4ee-836ed8fc670c\") " Jul 06 18:05:19.419672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419428 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-socket\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.419672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419443 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6edf1e29-4b38-40a1-b4ee-836ed8fc670c" (UID: "6edf1e29-4b38-40a1-b4ee-836ed8fc670c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:19.419672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419467 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-podinfo\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.419672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419520 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istiod-ca-cert\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.419672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419559 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-envoy\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.419672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419587 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:19.419672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419614 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2rdd\" (UniqueName: \"kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-kube-api-access-k2rdd\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.419672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419667 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-token\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.420180 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419746 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-certs\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.420180 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419760 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6edf1e29-4b38-40a1-b4ee-836ed8fc670c" (UID: "6edf1e29-4b38-40a1-b4ee-836ed8fc670c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:05:19.420180 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419787 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-credential-socket\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.420180 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419833 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-data\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.420180 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419879 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:19.420180 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419905 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:19.420180 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.419921 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:19.420671 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.420640 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6edf1e29-4b38-40a1-b4ee-836ed8fc670c" (UID: "6edf1e29-4b38-40a1-b4ee-836ed8fc670c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:19.421164 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.421139 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6edf1e29-4b38-40a1-b4ee-836ed8fc670c" (UID: "6edf1e29-4b38-40a1-b4ee-836ed8fc670c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:19.422131 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.422111 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6edf1e29-4b38-40a1-b4ee-836ed8fc670c" (UID: "6edf1e29-4b38-40a1-b4ee-836ed8fc670c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:19.422497 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.422473 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-kube-api-access-2f9l2" (OuterVolumeSpecName: "kube-api-access-2f9l2") pod "6edf1e29-4b38-40a1-b4ee-836ed8fc670c" (UID: "6edf1e29-4b38-40a1-b4ee-836ed8fc670c"). InnerVolumeSpecName "kube-api-access-2f9l2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:05:19.422733 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.422687 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6edf1e29-4b38-40a1-b4ee-836ed8fc670c" (UID: "6edf1e29-4b38-40a1-b4ee-836ed8fc670c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:05:19.422831 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.422745 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6edf1e29-4b38-40a1-b4ee-836ed8fc670c" (UID: "6edf1e29-4b38-40a1-b4ee-836ed8fc670c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:05:19.520851 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.520826 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-certs\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.520944 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.520857 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-credential-socket\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.520944 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.520879 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-data\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.520944 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.520910 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-socket\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.520944 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.520936 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-podinfo\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.521120 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.520973 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istiod-ca-cert\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.521120 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.520999 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-envoy\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.521120 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521035 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2rdd\" (UniqueName: \"kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-kube-api-access-k2rdd\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.521120 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521066 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-token\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.521120 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521101 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:19.521120 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521113 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:19.521414 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521124 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:19.521414 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521135 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:19.521414 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521145 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:19.521414 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521155 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f9l2\" (UniqueName: \"kubernetes.io/projected/6edf1e29-4b38-40a1-b4ee-836ed8fc670c-kube-api-access-2f9l2\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:19.521414 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521212 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-certs\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.521414 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521308 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-socket\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.521414 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521346 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-credential-socket\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.521661 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.521582 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-data\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.522127 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.522101 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istiod-ca-cert\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.523141 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.523123 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-envoy\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.523455 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.523435 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-podinfo\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.531361 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.531338 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-token\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.532896 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.532878 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2rdd\" (UniqueName: \"kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-kube-api-access-k2rdd\") pod \"e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.613206 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.613183 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:19.743509 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.743484 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5"] Jul 06 18:05:19.745200 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:05:19.745173 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa74e5c6_3765_488a_87fa_6e8df9d8576d.slice/crio-b6227ac436f472b29ddc1610a5838ca1ae586b2af1e2d89af5e07bb6685bfd97 WatchSource:0}: Error finding container b6227ac436f472b29ddc1610a5838ca1ae586b2af1e2d89af5e07bb6685bfd97: Status 404 returned error can't find the container with id b6227ac436f472b29ddc1610a5838ca1ae586b2af1e2d89af5e07bb6685bfd97 Jul 06 18:05:19.747207 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.747175 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:05:19.747314 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.747257 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:05:19.747314 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.747301 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:05:19.881383 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.881349 2539 generic.go:356] "Generic (PLEG): container finished" podID="6edf1e29-4b38-40a1-b4ee-836ed8fc670c" containerID="d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa" exitCode=0 Jul 06 18:05:19.881565 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.881393 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" Jul 06 18:05:19.881565 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.881438 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" event={"ID":"6edf1e29-4b38-40a1-b4ee-836ed8fc670c","Type":"ContainerDied","Data":"d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa"} Jul 06 18:05:19.881565 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.881491 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk" event={"ID":"6edf1e29-4b38-40a1-b4ee-836ed8fc670c","Type":"ContainerDied","Data":"2e40b556f02926576998dae5ffcd7586a87b3d52d39a6fac4bf0176901a4baef"} Jul 06 18:05:19.881565 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.881518 2539 scope.go:117] "RemoveContainer" containerID="d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa" Jul 06 18:05:19.883807 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.883781 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" event={"ID":"fa74e5c6-3765-488a-87fa-6e8df9d8576d","Type":"ContainerStarted","Data":"742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41"} Jul 06 18:05:19.883926 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.883835 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" event={"ID":"fa74e5c6-3765-488a-87fa-6e8df9d8576d","Type":"ContainerStarted","Data":"b6227ac436f472b29ddc1610a5838ca1ae586b2af1e2d89af5e07bb6685bfd97"} Jul 06 18:05:19.892166 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.892148 2539 scope.go:117] "RemoveContainer" containerID="d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa" Jul 06 18:05:19.892447 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:05:19.892430 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa\": container with ID starting with d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa not found: ID does not exist" containerID="d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa" Jul 06 18:05:19.892514 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.892455 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa"} err="failed to get container status \"d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa\": rpc error: code = NotFound desc = could not find container \"d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa\": container with ID starting with d1ab6d25ac0d356923d0598c56073fed895cf810ab371ec33cc2df5e54966daa not found: ID does not exist" Jul 06 18:05:19.906064 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.906014 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" podStartSLOduration=0.906001677 podStartE2EDuration="906.001677ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:05:19.902515882 +0000 UTC m=+1590.133761057" watchObservedRunningTime="2026-07-06 18:05:19.906001677 +0000 UTC m=+1590.137246851" Jul 06 18:05:19.918672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.918643 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk"] Jul 06 18:05:19.923101 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:19.923080 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2d5b0cda-openshift-default-79674bf6f-jbdtk"] Jul 06 18:05:20.304693 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:20.304662 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6edf1e29-4b38-40a1-b4ee-836ed8fc670c" path="/var/lib/kubelet/pods/6edf1e29-4b38-40a1-b4ee-836ed8fc670c/volumes" Jul 06 18:05:20.430539 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:20.430506 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:20.525295 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:20.525268 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:20.593928 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:20.593849 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:20.613353 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:20.613332 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:20.617772 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:20.617751 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:20.694775 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:20.694741 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:20.890464 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:20.890387 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:20.891305 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:20.891287 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:21.003526 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:21.003497 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:21.102729 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:21.102666 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:22.253811 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:22.253782 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:25.585544 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:25.585509 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:25.896443 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:25.896360 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:31.658669 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:31.658638 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5"] Jul 06 18:05:31.659061 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:31.658870 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" podUID="fa74e5c6-3765-488a-87fa-6e8df9d8576d" containerName="istio-proxy" containerID="cri-o://742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41" gracePeriod=30 Jul 06 18:05:31.684997 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:31.684954 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:31.781884 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:31.781847 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:35.892910 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:35.892866 2539 patch_prober.go:28] interesting pod/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 18:05:35.893268 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:35.892933 2539 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" podUID="fa74e5c6-3765-488a-87fa-6e8df9d8576d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 18:05:36.908863 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:36.908837 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:36.970575 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:36.970539 2539 generic.go:356] "Generic (PLEG): container finished" podID="fa74e5c6-3765-488a-87fa-6e8df9d8576d" containerID="742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41" exitCode=0 Jul 06 18:05:36.970693 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:36.970638 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" Jul 06 18:05:36.970693 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:36.970669 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" event={"ID":"fa74e5c6-3765-488a-87fa-6e8df9d8576d","Type":"ContainerDied","Data":"742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41"} Jul 06 18:05:36.970811 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:36.970750 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5" event={"ID":"fa74e5c6-3765-488a-87fa-6e8df9d8576d","Type":"ContainerDied","Data":"b6227ac436f472b29ddc1610a5838ca1ae586b2af1e2d89af5e07bb6685bfd97"} Jul 06 18:05:36.970811 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:36.970782 2539 scope.go:117] "RemoveContainer" containerID="742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41" Jul 06 18:05:36.980611 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:36.980593 2539 scope.go:117] "RemoveContainer" containerID="742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41" Jul 06 18:05:36.981022 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:05:36.980990 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41\": container with ID starting with 742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41 not found: ID does not exist" containerID="742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41" Jul 06 18:05:36.981109 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:36.981031 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41"} err="failed to get container status \"742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41\": rpc error: code = NotFound desc = could not find container \"742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41\": container with ID starting with 742a03e401d1451828009a68ce34863e324b586644f8921ade633b45ff09ad41 not found: ID does not exist" Jul 06 18:05:37.063947 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.063918 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-certs\") pod \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " Jul 06 18:05:37.064077 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.063958 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-token\") pod \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " Jul 06 18:05:37.064077 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.063998 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-envoy\") pod \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " Jul 06 18:05:37.064077 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064019 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istiod-ca-cert\") pod \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " Jul 06 18:05:37.064077 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064063 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2rdd\" (UniqueName: \"kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-kube-api-access-k2rdd\") pod \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " Jul 06 18:05:37.064283 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064091 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-podinfo\") pod \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " Jul 06 18:05:37.064283 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064160 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-socket\") pod \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " Jul 06 18:05:37.064283 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064190 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fa74e5c6-3765-488a-87fa-6e8df9d8576d" (UID: "fa74e5c6-3765-488a-87fa-6e8df9d8576d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:37.064283 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064243 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-data\") pod \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " Jul 06 18:05:37.064487 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064343 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-credential-socket\") pod \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\" (UID: \"fa74e5c6-3765-488a-87fa-6e8df9d8576d\") " Jul 06 18:05:37.064543 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064485 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fa74e5c6-3765-488a-87fa-6e8df9d8576d" (UID: "fa74e5c6-3765-488a-87fa-6e8df9d8576d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:05:37.064730 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064662 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fa74e5c6-3765-488a-87fa-6e8df9d8576d" (UID: "fa74e5c6-3765-488a-87fa-6e8df9d8576d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:37.064818 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064726 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:37.064818 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064750 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:37.064818 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064743 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-data" (OuterVolumeSpecName: "istio-data") pod "fa74e5c6-3765-488a-87fa-6e8df9d8576d" (UID: "fa74e5c6-3765-488a-87fa-6e8df9d8576d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:37.064943 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.064849 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fa74e5c6-3765-488a-87fa-6e8df9d8576d" (UID: "fa74e5c6-3765-488a-87fa-6e8df9d8576d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:37.066379 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.066350 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fa74e5c6-3765-488a-87fa-6e8df9d8576d" (UID: "fa74e5c6-3765-488a-87fa-6e8df9d8576d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:05:37.066500 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.066386 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-kube-api-access-k2rdd" (OuterVolumeSpecName: "kube-api-access-k2rdd") pod "fa74e5c6-3765-488a-87fa-6e8df9d8576d" (UID: "fa74e5c6-3765-488a-87fa-6e8df9d8576d"). InnerVolumeSpecName "kube-api-access-k2rdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:05:37.066779 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.066753 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fa74e5c6-3765-488a-87fa-6e8df9d8576d" (UID: "fa74e5c6-3765-488a-87fa-6e8df9d8576d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:37.066779 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.066753 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-token" (OuterVolumeSpecName: "istio-token") pod "fa74e5c6-3765-488a-87fa-6e8df9d8576d" (UID: "fa74e5c6-3765-488a-87fa-6e8df9d8576d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:05:37.165182 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.165154 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:37.165182 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.165177 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:37.165182 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.165186 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:37.165369 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.165194 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:37.165369 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.165202 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2rdd\" (UniqueName: \"kubernetes.io/projected/fa74e5c6-3765-488a-87fa-6e8df9d8576d-kube-api-access-k2rdd\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:37.165369 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.165210 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa74e5c6-3765-488a-87fa-6e8df9d8576d-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:37.165369 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.165217 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa74e5c6-3765-488a-87fa-6e8df9d8576d-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:37.291356 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.291328 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5"] Jul 06 18:05:37.295200 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.295173 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ad92259c-openshift-default-6fc7c95d9c-jkhd5"] Jul 06 18:05:37.593114 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.592975 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:37.694482 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.694434 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:37.700581 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.700555 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm"] Jul 06 18:05:37.700925 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.700910 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6edf1e29-4b38-40a1-b4ee-836ed8fc670c" containerName="istio-proxy" Jul 06 18:05:37.700979 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.700927 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="6edf1e29-4b38-40a1-b4ee-836ed8fc670c" containerName="istio-proxy" Jul 06 18:05:37.700979 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.700936 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa74e5c6-3765-488a-87fa-6e8df9d8576d" containerName="istio-proxy" Jul 06 18:05:37.700979 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.700942 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa74e5c6-3765-488a-87fa-6e8df9d8576d" containerName="istio-proxy" Jul 06 18:05:37.701068 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.701006 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa74e5c6-3765-488a-87fa-6e8df9d8576d" containerName="istio-proxy" Jul 06 18:05:37.701068 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.701015 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="6edf1e29-4b38-40a1-b4ee-836ed8fc670c" containerName="istio-proxy" Jul 06 18:05:37.704247 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.704224 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.706883 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.706862 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9e236323-openshift-default-dockercfg-fkftw\"" Jul 06 18:05:37.716888 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.716868 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm"] Jul 06 18:05:37.763643 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.763587 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:37.871655 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.871578 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmtg8\" (UniqueName: \"kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-kube-api-access-vmtg8\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.871655 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.871619 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-socket\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.871655 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.871645 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-envoy\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.871934 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.871745 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-certs\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.871934 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.871775 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-data\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.871934 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.871795 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-podinfo\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.871934 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.871818 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istiod-ca-cert\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.871934 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.871862 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-credential-socket\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.871934 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.871882 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-token\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.972273 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972243 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-certs\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.972687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972277 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-data\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.972687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972294 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-podinfo\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.972687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972312 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istiod-ca-cert\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.972687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972355 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-credential-socket\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.972687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972378 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-token\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.972687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972434 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmtg8\" (UniqueName: \"kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-kube-api-access-vmtg8\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.972687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972474 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-socket\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.972687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972516 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-envoy\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.973073 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972785 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-data\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.973073 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.972860 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-credential-socket\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.973073 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.973020 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-certs\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.973739 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.973349 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-socket\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.973739 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.973420 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istiod-ca-cert\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.974858 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.974829 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-envoy\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.974978 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.974931 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-podinfo\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.980281 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.980258 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmtg8\" (UniqueName: \"kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-kube-api-access-vmtg8\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:37.980379 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:37.980311 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-token\") pod \"e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:38.014995 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:38.014975 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:38.148651 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:38.145680 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm"] Jul 06 18:05:38.150105 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:05:38.150080 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e9444f6_37cd_4115_bc5c_ccda58e415cb.slice/crio-0ad797ae071e3943cb13f3188eac74cd33d933e80253b0259d0c3367c2b1db14 WatchSource:0}: Error finding container 0ad797ae071e3943cb13f3188eac74cd33d933e80253b0259d0c3367c2b1db14: Status 404 returned error can't find the container with id 0ad797ae071e3943cb13f3188eac74cd33d933e80253b0259d0c3367c2b1db14 Jul 06 18:05:38.152580 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:38.152543 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:05:38.152686 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:38.152617 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:05:38.152686 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:38.152658 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:05:38.305888 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:38.305847 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa74e5c6-3765-488a-87fa-6e8df9d8576d" path="/var/lib/kubelet/pods/fa74e5c6-3765-488a-87fa-6e8df9d8576d/volumes" Jul 06 18:05:38.870562 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:38.870532 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:38.940556 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:38.940528 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:38.985186 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:38.985151 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" event={"ID":"8e9444f6-37cd-4115-bc5c-ccda58e415cb","Type":"ContainerStarted","Data":"8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b"} Jul 06 18:05:38.985512 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:38.985216 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" event={"ID":"8e9444f6-37cd-4115-bc5c-ccda58e415cb","Type":"ContainerStarted","Data":"0ad797ae071e3943cb13f3188eac74cd33d933e80253b0259d0c3367c2b1db14"} Jul 06 18:05:39.019944 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:39.016063 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" podStartSLOduration=2.016042851 podStartE2EDuration="2.016042851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:05:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:05:39.007420559 +0000 UTC m=+1609.238665735" watchObservedRunningTime="2026-07-06 18:05:39.016042851 +0000 UTC m=+1609.247288026" Jul 06 18:05:39.019944 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:39.016579 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:39.020981 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:39.020507 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:39.026227 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:39.026198 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:39.437946 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:39.437911 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:39.552808 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:39.552781 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:39.689769 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:39.689673 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:39.990678 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:39.990598 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:39.991391 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:39.991371 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:43.301154 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:43.301119 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:43.359423 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:43.359381 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:43.507341 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:43.507300 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm"] Jul 06 18:05:43.507567 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:43.507537 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" podUID="8e9444f6-37cd-4115-bc5c-ccda58e415cb" containerName="istio-proxy" containerID="cri-o://8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b" gracePeriod=30 Jul 06 18:05:43.533011 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:43.532942 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:43.624999 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:43.624964 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:43.804174 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:43.804089 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:45.949167 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:45.949121 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:49.338167 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.338138 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:49.395911 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.395871 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:49.459959 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.459912 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:49.467576 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.467559 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmtg8\" (UniqueName: \"kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-kube-api-access-vmtg8\") pod \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " Jul 06 18:05:49.467668 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.467585 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istiod-ca-cert\") pod \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " Jul 06 18:05:49.467668 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.467608 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-envoy\") pod \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " Jul 06 18:05:49.467668 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.467640 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-credential-socket\") pod \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " Jul 06 18:05:49.467809 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.467757 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-token\") pod \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " Jul 06 18:05:49.467862 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.467841 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-certs\") pod \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " Jul 06 18:05:49.467936 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.467912 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8e9444f6-37cd-4115-bc5c-ccda58e415cb" (UID: "8e9444f6-37cd-4115-bc5c-ccda58e415cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:49.468005 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.467924 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-podinfo\") pod \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " Jul 06 18:05:49.468005 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.467981 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-socket\") pod \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " Jul 06 18:05:49.468106 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.468004 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8e9444f6-37cd-4115-bc5c-ccda58e415cb" (UID: "8e9444f6-37cd-4115-bc5c-ccda58e415cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:05:49.468106 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.468011 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-data\") pod \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\" (UID: \"8e9444f6-37cd-4115-bc5c-ccda58e415cb\") " Jul 06 18:05:49.468217 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.468133 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8e9444f6-37cd-4115-bc5c-ccda58e415cb" (UID: "8e9444f6-37cd-4115-bc5c-ccda58e415cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:49.468358 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.468311 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8e9444f6-37cd-4115-bc5c-ccda58e415cb" (UID: "8e9444f6-37cd-4115-bc5c-ccda58e415cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:49.468844 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.468822 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:49.468931 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.468848 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:49.468931 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.468864 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:49.468931 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.468879 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:49.469093 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.468940 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "8e9444f6-37cd-4115-bc5c-ccda58e415cb" (UID: "8e9444f6-37cd-4115-bc5c-ccda58e415cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:49.469900 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.469870 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8e9444f6-37cd-4115-bc5c-ccda58e415cb" (UID: "8e9444f6-37cd-4115-bc5c-ccda58e415cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:05:49.469900 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.469895 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-kube-api-access-vmtg8" (OuterVolumeSpecName: "kube-api-access-vmtg8") pod "8e9444f6-37cd-4115-bc5c-ccda58e415cb" (UID: "8e9444f6-37cd-4115-bc5c-ccda58e415cb"). InnerVolumeSpecName "kube-api-access-vmtg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:05:49.470053 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.469969 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "8e9444f6-37cd-4115-bc5c-ccda58e415cb" (UID: "8e9444f6-37cd-4115-bc5c-ccda58e415cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:05:49.470053 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.470003 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8e9444f6-37cd-4115-bc5c-ccda58e415cb" (UID: "8e9444f6-37cd-4115-bc5c-ccda58e415cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:05:49.570254 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.570194 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:49.570254 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.570215 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:49.570254 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.570224 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmtg8\" (UniqueName: \"kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-kube-api-access-vmtg8\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:49.570254 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.570233 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:49.570254 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.570240 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8e9444f6-37cd-4115-bc5c-ccda58e415cb-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:05:49.856434 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:49.856359 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:50.021015 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.020983 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:50.057923 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.057890 2539 generic.go:356] "Generic (PLEG): container finished" podID="8e9444f6-37cd-4115-bc5c-ccda58e415cb" containerID="8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b" exitCode=0 Jul 06 18:05:50.058056 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.057940 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" Jul 06 18:05:50.058056 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.057965 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" event={"ID":"8e9444f6-37cd-4115-bc5c-ccda58e415cb","Type":"ContainerDied","Data":"8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b"} Jul 06 18:05:50.058056 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.058034 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm" event={"ID":"8e9444f6-37cd-4115-bc5c-ccda58e415cb","Type":"ContainerDied","Data":"0ad797ae071e3943cb13f3188eac74cd33d933e80253b0259d0c3367c2b1db14"} Jul 06 18:05:50.058181 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.058056 2539 scope.go:117] "RemoveContainer" containerID="8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b" Jul 06 18:05:50.067271 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.067257 2539 scope.go:117] "RemoveContainer" containerID="8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b" Jul 06 18:05:50.067516 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:05:50.067496 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b\": container with ID starting with 8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b not found: ID does not exist" containerID="8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b" Jul 06 18:05:50.067573 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.067522 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b"} err="failed to get container status \"8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b\": rpc error: code = NotFound desc = could not find container \"8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b\": container with ID starting with 8eb490b3622b54965853d7556ac569d4d9c4345dfe82281fbb3b2117e55f171b not found: ID does not exist" Jul 06 18:05:50.082130 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.082101 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm"] Jul 06 18:05:50.088300 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.088280 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9e236323-openshift-default-6465f7f49f-8jbrm"] Jul 06 18:05:50.092147 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.092129 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:50.304171 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:50.304146 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e9444f6-37cd-4115-bc5c-ccda58e415cb" path="/var/lib/kubelet/pods/8e9444f6-37cd-4115-bc5c-ccda58e415cb/volumes" Jul 06 18:05:51.486130 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:51.486097 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:53.452749 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:53.452718 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:56.281196 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:56.281161 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:57.229130 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:57.229100 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:57.338479 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:57.338448 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:57.431932 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:57.431897 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:57.531112 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:57.531044 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:05:57.973758 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:05:57.973728 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:06:23.977478 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:06:23.977417 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:06:29.544488 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:06:29.544453 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:06:29.603576 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:06:29.603551 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:06:29.682838 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:06:29.682805 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:06:29.775290 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:06:29.775262 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:06:45.659021 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:06:45.658984 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:06:51.276032 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:06:51.275997 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:06:51.384648 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:06:51.384610 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:06:51.474439 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:06:51.474407 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:06:52.700993 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:06:52.700959 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:02.033209 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:02.033172 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:02.851181 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:02.851140 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:08.433374 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:08.433335 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:08.546449 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:08.546420 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:08.633919 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:08.633889 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:08.733780 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:08.733716 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:09.484740 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:09.484665 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:09.580159 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:09.580125 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:09.680404 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:09.680373 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:11.310267 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:11.310180 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:17.246523 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:17.246482 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:17.347003 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:17.346973 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:17.938761 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:17.938728 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:23.546575 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:23.546538 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:24.071710 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.071663 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t"] Jul 06 18:07:24.072050 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.072036 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e9444f6-37cd-4115-bc5c-ccda58e415cb" containerName="istio-proxy" Jul 06 18:07:24.072096 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.072052 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e9444f6-37cd-4115-bc5c-ccda58e415cb" containerName="istio-proxy" Jul 06 18:07:24.072129 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.072113 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e9444f6-37cd-4115-bc5c-ccda58e415cb" containerName="istio-proxy" Jul 06 18:07:24.074388 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.074372 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.076909 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.076886 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2fc77276-openshift-default-dockercfg-mxxxx\"" Jul 06 18:07:24.090753 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.090730 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t"] Jul 06 18:07:24.223301 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.223270 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-socket\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.223489 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.223335 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-podinfo\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.223489 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.223362 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istiod-ca-cert\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.223489 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.223400 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-data\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.223489 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.223450 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ll4k\" (UniqueName: \"kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-kube-api-access-6ll4k\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.223726 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.223529 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-credential-socket\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.223726 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.223558 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-certs\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.223726 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.223590 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-envoy\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.223726 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.223619 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-token\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.324742 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.324653 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-token\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.324742 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.324723 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-socket\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.324951 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.324770 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-podinfo\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.324951 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.324789 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istiod-ca-cert\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.324951 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.324829 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-data\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.324951 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.324852 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ll4k\" (UniqueName: \"kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-kube-api-access-6ll4k\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.324951 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.324904 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-credential-socket\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.324951 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.324934 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-certs\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.325258 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.325101 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-envoy\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.325258 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.325208 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-socket\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.325258 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.325240 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-credential-socket\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.325365 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.325286 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-certs\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.325365 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.325343 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-data\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.325716 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.325659 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istiod-ca-cert\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.327458 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.327427 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-envoy\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.327636 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.327620 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-podinfo\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.332556 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.332534 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ll4k\" (UniqueName: \"kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-kube-api-access-6ll4k\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.332669 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.332575 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-token\") pod \"e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.383874 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.383855 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:24.514243 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.514219 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t"] Jul 06 18:07:24.516009 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:07:24.515981 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40e94c8_36b5_494f_b20e_bc69ebf2dc82.slice/crio-01e0c03e0ec61f1395fb7688f8d0a0cbf0d4c6bc627fe7cab91a3727627cae76 WatchSource:0}: Error finding container 01e0c03e0ec61f1395fb7688f8d0a0cbf0d4c6bc627fe7cab91a3727627cae76: Status 404 returned error can't find the container with id 01e0c03e0ec61f1395fb7688f8d0a0cbf0d4c6bc627fe7cab91a3727627cae76 Jul 06 18:07:24.518063 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.518029 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:07:24.518136 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.518115 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:07:24.518192 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.518177 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:07:24.696938 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:24.696908 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:25.520412 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:25.520374 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" event={"ID":"a40e94c8-36b5-494f-b20e-bc69ebf2dc82","Type":"ContainerStarted","Data":"bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98"} Jul 06 18:07:25.520574 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:25.520423 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" event={"ID":"a40e94c8-36b5-494f-b20e-bc69ebf2dc82","Type":"ContainerStarted","Data":"01e0c03e0ec61f1395fb7688f8d0a0cbf0d4c6bc627fe7cab91a3727627cae76"} Jul 06 18:07:25.542828 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:25.542776 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" podStartSLOduration=1.542761748 podStartE2EDuration="1.542761748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:07:25.540528261 +0000 UTC m=+1715.771773437" watchObservedRunningTime="2026-07-06 18:07:25.542761748 +0000 UTC m=+1715.774006930" Jul 06 18:07:26.384359 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:26.384328 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:26.389315 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:26.389293 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:26.525716 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:26.525668 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:26.526508 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:26.526488 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:27.461277 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:27.461241 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:27.559067 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:27.559036 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:27.685514 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:27.685476 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:28.043254 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:28.043221 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:28.143603 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:28.143571 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:31.967285 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:31.967254 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:40.597418 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:40.597384 2539 generic.go:356] "Generic (PLEG): container finished" podID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerID="bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98" exitCode=0 Jul 06 18:07:40.597840 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:40.597458 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" event={"ID":"a40e94c8-36b5-494f-b20e-bc69ebf2dc82","Type":"ContainerDied","Data":"bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98"} Jul 06 18:07:40.597840 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:40.597828 2539 scope.go:117] "RemoveContainer" containerID="bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98" Jul 06 18:07:40.598818 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:40.598791 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:07:40.598899 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:40.598859 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:07:40.598899 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:40.598889 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:07:41.526307 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:41.526273 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:41.605051 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:41.605016 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" event={"ID":"a40e94c8-36b5-494f-b20e-bc69ebf2dc82","Type":"ContainerStarted","Data":"7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956"} Jul 06 18:07:42.384210 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:42.384178 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:42.385278 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:42.385250 2539 patch_prober.go:28] interesting pod/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 06 18:07:42.385400 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:42.385297 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 06 18:07:42.678039 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:42.678005 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:42.776448 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:42.776415 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:43.129027 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:43.128946 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:43.384978 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:43.384898 2539 patch_prober.go:28] interesting pod/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 06 18:07:43.384978 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:43.384953 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 06 18:07:44.384809 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:44.384777 2539 patch_prober.go:28] interesting pod/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 06 18:07:44.385187 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:44.384829 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 06 18:07:45.385039 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:45.385008 2539 patch_prober.go:28] interesting pod/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 06 18:07:45.385429 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:45.385062 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 06 18:07:46.388018 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:46.387991 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:46.388374 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:46.388252 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:46.389012 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:46.388996 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:07:48.786446 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:48.786413 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:48.884625 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:48.884594 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:49.199013 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:49.198987 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:49.524984 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:49.524906 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:49.625010 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:49.624978 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:55.535546 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:55.535507 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:55.606979 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:55.606944 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:55.798057 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:55.797979 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t"] Jul 06 18:07:55.798216 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:55.798157 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" containerID="cri-o://7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956" gracePeriod=30 Jul 06 18:07:55.814541 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:55.814516 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:56.041889 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:56.041857 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:56.167784 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:56.167673 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:56.267198 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:56.267159 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:07:56.416845 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:07:56.416812 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:01.046678 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.046655 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:08:01.141597 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.141519 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-credential-socket\") pod \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " Jul 06 18:08:01.141597 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.141573 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-envoy\") pod \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " Jul 06 18:08:01.141597 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.141592 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-data\") pod \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " Jul 06 18:08:01.141870 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.141625 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-token\") pod \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " Jul 06 18:08:01.141870 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.141644 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ll4k\" (UniqueName: \"kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-kube-api-access-6ll4k\") pod \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " Jul 06 18:08:01.141870 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.141718 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-certs\") pod \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " Jul 06 18:08:01.141870 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.141840 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-socket\") pod \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " Jul 06 18:08:01.142067 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.141840 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a40e94c8-36b5-494f-b20e-bc69ebf2dc82" (UID: "a40e94c8-36b5-494f-b20e-bc69ebf2dc82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:08:01.142067 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.141976 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a40e94c8-36b5-494f-b20e-bc69ebf2dc82" (UID: "a40e94c8-36b5-494f-b20e-bc69ebf2dc82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:08:01.142067 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.142040 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a40e94c8-36b5-494f-b20e-bc69ebf2dc82" (UID: "a40e94c8-36b5-494f-b20e-bc69ebf2dc82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:08:01.142193 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.142116 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-podinfo\") pod \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " Jul 06 18:08:01.142193 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.142137 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istiod-ca-cert\") pod \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\" (UID: \"a40e94c8-36b5-494f-b20e-bc69ebf2dc82\") " Jul 06 18:08:01.142510 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.142483 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:08:01.142616 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.142517 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:08:01.142616 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.142534 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a40e94c8-36b5-494f-b20e-bc69ebf2dc82" (UID: "a40e94c8-36b5-494f-b20e-bc69ebf2dc82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:08:01.142616 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.142531 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:08:01.142803 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.142781 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-data" (OuterVolumeSpecName: "istio-data") pod "a40e94c8-36b5-494f-b20e-bc69ebf2dc82" (UID: "a40e94c8-36b5-494f-b20e-bc69ebf2dc82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:08:01.144024 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.143993 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-kube-api-access-6ll4k" (OuterVolumeSpecName: "kube-api-access-6ll4k") pod "a40e94c8-36b5-494f-b20e-bc69ebf2dc82" (UID: "a40e94c8-36b5-494f-b20e-bc69ebf2dc82"). InnerVolumeSpecName "kube-api-access-6ll4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:08:01.144315 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.144289 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a40e94c8-36b5-494f-b20e-bc69ebf2dc82" (UID: "a40e94c8-36b5-494f-b20e-bc69ebf2dc82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:08:01.144416 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.144296 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a40e94c8-36b5-494f-b20e-bc69ebf2dc82" (UID: "a40e94c8-36b5-494f-b20e-bc69ebf2dc82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:08:01.144416 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.144393 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-token" (OuterVolumeSpecName: "istio-token") pod "a40e94c8-36b5-494f-b20e-bc69ebf2dc82" (UID: "a40e94c8-36b5-494f-b20e-bc69ebf2dc82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:08:01.243228 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.243199 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ll4k\" (UniqueName: \"kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-kube-api-access-6ll4k\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:08:01.243228 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.243226 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:08:01.243370 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.243238 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:08:01.243370 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.243251 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:08:01.243370 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.243262 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:08:01.243370 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.243274 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a40e94c8-36b5-494f-b20e-bc69ebf2dc82-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:08:01.714202 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.714164 2539 generic.go:356] "Generic (PLEG): container finished" podID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerID="7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956" exitCode=0 Jul 06 18:08:01.714366 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.714207 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" event={"ID":"a40e94c8-36b5-494f-b20e-bc69ebf2dc82","Type":"ContainerDied","Data":"7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956"} Jul 06 18:08:01.714366 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.714263 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" event={"ID":"a40e94c8-36b5-494f-b20e-bc69ebf2dc82","Type":"ContainerDied","Data":"01e0c03e0ec61f1395fb7688f8d0a0cbf0d4c6bc627fe7cab91a3727627cae76"} Jul 06 18:08:01.714366 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.714285 2539 scope.go:117] "RemoveContainer" containerID="7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956" Jul 06 18:08:01.714366 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.714217 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t" Jul 06 18:08:01.724083 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.724063 2539 scope.go:117] "RemoveContainer" containerID="bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98" Jul 06 18:08:01.731783 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.731764 2539 scope.go:117] "RemoveContainer" containerID="7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956" Jul 06 18:08:01.732092 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:08:01.732073 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956\": container with ID starting with 7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956 not found: ID does not exist" containerID="7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956" Jul 06 18:08:01.732151 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.732100 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956"} err="failed to get container status \"7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956\": rpc error: code = NotFound desc = could not find container \"7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956\": container with ID starting with 7edd6d580ee9a6610db14f3f9bd6b62d46c990abd188d2af3b196191af2ec956 not found: ID does not exist" Jul 06 18:08:01.732151 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.732115 2539 scope.go:117] "RemoveContainer" containerID="bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98" Jul 06 18:08:01.732360 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:08:01.732341 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98\": container with ID starting with bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98 not found: ID does not exist" containerID="bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98" Jul 06 18:08:01.732412 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.732370 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98"} err="failed to get container status \"bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98\": rpc error: code = NotFound desc = could not find container \"bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98\": container with ID starting with bd2908caf78f47b7e6ea9d2e69f7bb9e5afce18928e72754cec90dd04573bf98 not found: ID does not exist" Jul 06 18:08:01.739337 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.739308 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t"] Jul 06 18:08:01.743132 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:01.743109 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2fc77276-openshift-default-66c69c5fb7-znt5t"] Jul 06 18:08:02.304110 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:02.304067 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" path="/var/lib/kubelet/pods/a40e94c8-36b5-494f-b20e-bc69ebf2dc82/volumes" Jul 06 18:08:02.314379 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:02.314347 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:02.390174 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:02.390148 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:02.468146 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:02.468107 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:02.559913 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:02.559835 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:02.681712 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:02.681671 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:08.471021 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:08.470987 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:08.570954 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:08.570922 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:15.402620 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.402585 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:15.698546 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.698517 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg"] Jul 06 18:08:15.698858 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.698846 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" Jul 06 18:08:15.698918 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.698860 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" Jul 06 18:08:15.698953 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.698926 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" Jul 06 18:08:15.702123 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.702105 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.704958 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.704938 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-214076ae-openshift-default-dockercfg-sxn6s\"" Jul 06 18:08:15.712374 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.712353 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg"] Jul 06 18:08:15.721135 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.721107 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:15.769370 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.769348 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8ffcb69-f346-4587-8131-f97e47255e69-istio-podinfo\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.769463 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.769372 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-istio-token\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.769463 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.769402 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4j2m\" (UniqueName: \"kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-kube-api-access-l4j2m\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.769544 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.769479 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-socket\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.769544 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.769501 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-certs\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.769544 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.769533 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-data\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.769638 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.769553 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-credential-socket\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.769638 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.769599 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-envoy\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.769638 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.769617 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8ffcb69-f346-4587-8131-f97e47255e69-istiod-ca-cert\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.870492 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870461 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-socket\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.870492 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870495 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-certs\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.870728 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870520 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-data\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.870728 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870547 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-credential-socket\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.870728 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870571 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-envoy\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.870728 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870586 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8ffcb69-f346-4587-8131-f97e47255e69-istiod-ca-cert\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.870935 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870780 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8ffcb69-f346-4587-8131-f97e47255e69-istio-podinfo\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.870935 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870828 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-istio-token\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.870935 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870886 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4j2m\" (UniqueName: \"kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-kube-api-access-l4j2m\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.870935 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870898 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-socket\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.871130 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.870938 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-certs\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.871130 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.871006 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-credential-socket\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.871130 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.871034 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-data\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.871288 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.871273 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8ffcb69-f346-4587-8131-f97e47255e69-istiod-ca-cert\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.873108 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.873084 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-envoy\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.873429 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.873407 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8ffcb69-f346-4587-8131-f97e47255e69-istio-podinfo\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.878635 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.878606 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4j2m\" (UniqueName: \"kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-kube-api-access-l4j2m\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.879237 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.879208 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-istio-token\") pod \"e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:15.992146 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:15.992071 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:16.013155 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:16.013129 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:16.146315 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:16.146280 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg"] Jul 06 18:08:16.149624 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:08:16.149599 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8ffcb69_f346_4587_8131_f97e47255e69.slice/crio-670a4a55aa58a8ac9f3635d204aabb33d7a5b6815e83cd5e8e0e5447ecea4603 WatchSource:0}: Error finding container 670a4a55aa58a8ac9f3635d204aabb33d7a5b6815e83cd5e8e0e5447ecea4603: Status 404 returned error can't find the container with id 670a4a55aa58a8ac9f3635d204aabb33d7a5b6815e83cd5e8e0e5447ecea4603 Jul 06 18:08:16.151845 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:16.151811 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:08:16.151928 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:16.151891 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:08:16.151969 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:16.151939 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:08:16.799540 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:16.799504 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" event={"ID":"d8ffcb69-f346-4587-8131-f97e47255e69","Type":"ContainerStarted","Data":"40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28"} Jul 06 18:08:16.800007 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:16.799577 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" event={"ID":"d8ffcb69-f346-4587-8131-f97e47255e69","Type":"ContainerStarted","Data":"670a4a55aa58a8ac9f3635d204aabb33d7a5b6815e83cd5e8e0e5447ecea4603"} Jul 06 18:08:16.820446 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:16.820392 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" podStartSLOduration=1.820377901 podStartE2EDuration="1.820377901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:08:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:08:16.81836775 +0000 UTC m=+1767.049612926" watchObservedRunningTime="2026-07-06 18:08:16.820377901 +0000 UTC m=+1767.051623076" Jul 06 18:08:17.013882 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:17.013845 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:17.018528 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:17.018504 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:17.804292 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:17.804263 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:17.805254 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:17.805235 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:18.719070 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:18.719041 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:18.851920 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:18.851882 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:19.014990 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:19.014907 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:19.316401 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:19.316328 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:19.519073 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:19.519042 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:19.610656 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:19.610586 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:20.385526 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:20.385497 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:20.486224 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:20.486200 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:21.081900 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:21.081868 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:21.185622 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:21.185593 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:23.227492 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:23.227460 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:31.255033 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:31.254996 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:31.356679 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:31.356640 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:32.806156 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:32.806119 2539 patch_prober.go:28] interesting pod/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 06 18:08:32.806561 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:32.806181 2539 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 06 18:08:32.882953 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:32.882921 2539 generic.go:356] "Generic (PLEG): container finished" podID="d8ffcb69-f346-4587-8131-f97e47255e69" containerID="40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28" exitCode=0 Jul 06 18:08:32.883091 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:32.882969 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" event={"ID":"d8ffcb69-f346-4587-8131-f97e47255e69","Type":"ContainerDied","Data":"40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28"} Jul 06 18:08:32.883344 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:32.883318 2539 scope.go:117] "RemoveContainer" containerID="40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28" Jul 06 18:08:32.884293 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:32.884262 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:08:32.884362 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:32.884347 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:08:32.884400 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:32.884386 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:08:33.889904 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:33.889871 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" event={"ID":"d8ffcb69-f346-4587-8131-f97e47255e69","Type":"ContainerStarted","Data":"f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c"} Jul 06 18:08:34.013902 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:34.013860 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:34.014104 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:34.013989 2539 patch_prober.go:28] interesting pod/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 06 18:08:34.014104 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:34.014044 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 06 18:08:35.013505 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:35.013468 2539 patch_prober.go:28] interesting pod/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 06 18:08:35.014003 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:35.013530 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 06 18:08:36.014190 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:36.014148 2539 patch_prober.go:28] interesting pod/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 06 18:08:36.014812 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:36.014769 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 06 18:08:37.013870 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:37.013833 2539 patch_prober.go:28] interesting pod/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 06 18:08:37.014186 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:37.014156 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 06 18:08:38.017565 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:38.017534 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:38.017941 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:38.017791 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:38.018355 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:38.018339 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:08:39.132630 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:39.132597 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:08:50.297553 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:50.297519 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 18:08:50.301200 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:08:50.301176 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 18:09:00.815071 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:00.815024 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:01.193836 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:01.193804 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:06.900860 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:06.900820 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:11.929869 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:11.929836 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:48.049289 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:48.049243 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:48.948104 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:48.948065 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:54.479078 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:54.479041 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:54.580399 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:54.580370 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:54.729905 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:54.729817 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg"] Jul 06 18:09:54.730087 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:54.730060 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" containerID="cri-o://f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c" gracePeriod=30 Jul 06 18:09:54.744916 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:54.744881 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:54.978960 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:54.978930 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:56.039337 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:56.039303 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:56.139421 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:56.139390 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:56.239256 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:56.239228 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:56.978816 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:56.978782 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:57.079042 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:57.079013 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:57.181466 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:57.181435 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:57.553183 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:57.553150 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:58.593589 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:58.593557 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:09:59.970631 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:09:59.970602 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:10:00.062898 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.062805 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-certs\") pod \"d8ffcb69-f346-4587-8131-f97e47255e69\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " Jul 06 18:10:00.062898 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.062863 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-data\") pod \"d8ffcb69-f346-4587-8131-f97e47255e69\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " Jul 06 18:10:00.063131 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.062928 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8ffcb69-f346-4587-8131-f97e47255e69-istiod-ca-cert\") pod \"d8ffcb69-f346-4587-8131-f97e47255e69\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " Jul 06 18:10:00.063131 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.062974 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-istio-token\") pod \"d8ffcb69-f346-4587-8131-f97e47255e69\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " Jul 06 18:10:00.063131 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.062999 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-socket\") pod \"d8ffcb69-f346-4587-8131-f97e47255e69\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " Jul 06 18:10:00.063131 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063038 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8ffcb69-f346-4587-8131-f97e47255e69-istio-podinfo\") pod \"d8ffcb69-f346-4587-8131-f97e47255e69\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " Jul 06 18:10:00.063333 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063134 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8ffcb69-f346-4587-8131-f97e47255e69" (UID: "d8ffcb69-f346-4587-8131-f97e47255e69"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:10:00.063333 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063187 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-credential-socket\") pod \"d8ffcb69-f346-4587-8131-f97e47255e69\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " Jul 06 18:10:00.063333 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063234 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4j2m\" (UniqueName: \"kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-kube-api-access-l4j2m\") pod \"d8ffcb69-f346-4587-8131-f97e47255e69\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " Jul 06 18:10:00.063333 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063281 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-envoy\") pod \"d8ffcb69-f346-4587-8131-f97e47255e69\" (UID: \"d8ffcb69-f346-4587-8131-f97e47255e69\") " Jul 06 18:10:00.063521 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063387 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8ffcb69-f346-4587-8131-f97e47255e69" (UID: "d8ffcb69-f346-4587-8131-f97e47255e69"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:10:00.063521 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063421 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8ffcb69-f346-4587-8131-f97e47255e69-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8ffcb69-f346-4587-8131-f97e47255e69" (UID: "d8ffcb69-f346-4587-8131-f97e47255e69"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:10:00.063521 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063432 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8ffcb69-f346-4587-8131-f97e47255e69" (UID: "d8ffcb69-f346-4587-8131-f97e47255e69"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:10:00.063658 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063615 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:10:00.063658 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063631 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:10:00.063658 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063640 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8ffcb69-f346-4587-8131-f97e47255e69-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:10:00.063658 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063655 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:10:00.063966 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.063945 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8ffcb69-f346-4587-8131-f97e47255e69" (UID: "d8ffcb69-f346-4587-8131-f97e47255e69"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:10:00.065390 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.065370 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8ffcb69-f346-4587-8131-f97e47255e69" (UID: "d8ffcb69-f346-4587-8131-f97e47255e69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:10:00.065540 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.065384 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8ffcb69-f346-4587-8131-f97e47255e69" (UID: "d8ffcb69-f346-4587-8131-f97e47255e69"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:10:00.065863 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.065847 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-kube-api-access-l4j2m" (OuterVolumeSpecName: "kube-api-access-l4j2m") pod "d8ffcb69-f346-4587-8131-f97e47255e69" (UID: "d8ffcb69-f346-4587-8131-f97e47255e69"). InnerVolumeSpecName "kube-api-access-l4j2m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:10:00.065863 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.065847 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8ffcb69-f346-4587-8131-f97e47255e69-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8ffcb69-f346-4587-8131-f97e47255e69" (UID: "d8ffcb69-f346-4587-8131-f97e47255e69"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:10:00.164539 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.164502 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:10:00.164539 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.164531 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8ffcb69-f346-4587-8131-f97e47255e69-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:10:00.164539 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.164540 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4j2m\" (UniqueName: \"kubernetes.io/projected/d8ffcb69-f346-4587-8131-f97e47255e69-kube-api-access-l4j2m\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:10:00.164539 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.164550 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:10:00.164840 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.164557 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8ffcb69-f346-4587-8131-f97e47255e69-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:10:00.323343 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.323271 2539 generic.go:356] "Generic (PLEG): container finished" podID="d8ffcb69-f346-4587-8131-f97e47255e69" containerID="f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c" exitCode=0 Jul 06 18:10:00.323343 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.323306 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" Jul 06 18:10:00.323490 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.323359 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" event={"ID":"d8ffcb69-f346-4587-8131-f97e47255e69","Type":"ContainerDied","Data":"f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c"} Jul 06 18:10:00.323490 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.323404 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg" event={"ID":"d8ffcb69-f346-4587-8131-f97e47255e69","Type":"ContainerDied","Data":"670a4a55aa58a8ac9f3635d204aabb33d7a5b6815e83cd5e8e0e5447ecea4603"} Jul 06 18:10:00.323490 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.323427 2539 scope.go:117] "RemoveContainer" containerID="f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c" Jul 06 18:10:00.332323 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.332305 2539 scope.go:117] "RemoveContainer" containerID="40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28" Jul 06 18:10:00.341786 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.341760 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg"] Jul 06 18:10:00.342279 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.342263 2539 scope.go:117] "RemoveContainer" containerID="f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c" Jul 06 18:10:00.342551 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:10:00.342530 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c\": container with ID starting with f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c not found: ID does not exist" containerID="f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c" Jul 06 18:10:00.342635 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.342563 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c"} err="failed to get container status \"f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c\": rpc error: code = NotFound desc = could not find container \"f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c\": container with ID starting with f8866221aaba2b020a6e13cded757dc742bb0a394cda7729c65cdfdeae00645c not found: ID does not exist" Jul 06 18:10:00.342635 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.342581 2539 scope.go:117] "RemoveContainer" containerID="40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28" Jul 06 18:10:00.342940 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:10:00.342905 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28\": container with ID starting with 40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28 not found: ID does not exist" containerID="40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28" Jul 06 18:10:00.343043 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.342950 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28"} err="failed to get container status \"40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28\": rpc error: code = NotFound desc = could not find container \"40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28\": container with ID starting with 40539ba2defc3354f3ec349d4b8963e60389dcd5b5e202dab37c670e371bac28 not found: ID does not exist" Jul 06 18:10:00.346128 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:00.346108 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-214076ae-openshift-default-6d8cfb875-8nnqg"] Jul 06 18:10:02.304089 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:02.304059 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" path="/var/lib/kubelet/pods/d8ffcb69-f346-4587-8131-f97e47255e69/volumes" Jul 06 18:10:04.397448 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:04.397415 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:04.472569 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:04.472505 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:05.078764 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:05.078730 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:10.898461 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:10.898377 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:10.999040 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:10.999009 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:11.100934 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:11.100903 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:21.579389 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:21.579355 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:21.933139 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:21.933107 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:42.911620 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:42.911585 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:48.586753 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:48.586723 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:48.658306 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:48.658275 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:52.001851 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.001816 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:52.283947 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.283865 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv"] Jul 06 18:10:52.284225 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.284211 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" Jul 06 18:10:52.284268 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.284227 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" Jul 06 18:10:52.284268 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.284248 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" Jul 06 18:10:52.284268 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.284253 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" Jul 06 18:10:52.284358 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.284307 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" Jul 06 18:10:52.284358 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.284316 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="a40e94c8-36b5-494f-b20e-bc69ebf2dc82" containerName="istio-proxy" Jul 06 18:10:52.284358 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.284323 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" Jul 06 18:10:52.286370 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.286354 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.289016 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.288988 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-b635d0-openshift-default-dockercfg-jg876\"" Jul 06 18:10:52.297993 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.297966 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv"] Jul 06 18:10:52.301472 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.301447 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:52.401289 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.401258 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-data\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.401473 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.401297 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istiod-ca-cert\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.401473 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.401315 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-envoy\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.401473 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.401381 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-token\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.401473 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.401443 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-certs\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.401639 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.401516 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-socket\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.401639 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.401570 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-credential-socket\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.401639 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.401597 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-podinfo\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.401639 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.401621 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxrvg\" (UniqueName: \"kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-kube-api-access-bxrvg\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502148 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502107 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-certs\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502352 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502158 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-socket\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502352 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502192 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-credential-socket\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502352 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502218 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-podinfo\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502352 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502241 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxrvg\" (UniqueName: \"kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-kube-api-access-bxrvg\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502352 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502317 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-data\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502352 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502350 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istiod-ca-cert\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502653 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502378 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-envoy\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502653 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502416 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-token\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502653 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502581 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-certs\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502653 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502602 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-credential-socket\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502847 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502667 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-socket\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.502847 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.502691 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-data\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.503159 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.503142 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istiod-ca-cert\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.504797 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.504774 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-envoy\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.504938 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.504909 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-podinfo\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.513500 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.513471 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxrvg\" (UniqueName: \"kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-kube-api-access-bxrvg\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.513613 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.513520 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-token\") pod \"e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.540469 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.540393 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:52.596179 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.596151 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:52.735936 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.735911 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv"] Jul 06 18:10:52.737529 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:10:52.737492 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f927b6a_09ba_4da3_b51a_c1317a62eb3c.slice/crio-3de8b43295ab0838388bcbc50e944d4af105a3189d111e085b42af03c6d1792c WatchSource:0}: Error finding container 3de8b43295ab0838388bcbc50e944d4af105a3189d111e085b42af03c6d1792c: Status 404 returned error can't find the container with id 3de8b43295ab0838388bcbc50e944d4af105a3189d111e085b42af03c6d1792c Jul 06 18:10:52.739748 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.739686 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:10:52.739855 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.739781 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:10:52.739855 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:52.739829 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:10:53.590278 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:53.590246 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" event={"ID":"4f927b6a-09ba-4da3-b51a-c1317a62eb3c","Type":"ContainerStarted","Data":"5446c0f753610b91fb07dd3f023673592b56435e3f9c5ea276e756b0ccc63386"} Jul 06 18:10:53.590666 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:53.590296 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" event={"ID":"4f927b6a-09ba-4da3-b51a-c1317a62eb3c","Type":"ContainerStarted","Data":"3de8b43295ab0838388bcbc50e944d4af105a3189d111e085b42af03c6d1792c"} Jul 06 18:10:53.597034 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:53.597015 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:53.601733 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:53.601690 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:53.613674 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:53.613628 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" podStartSLOduration=1.613613113 podStartE2EDuration="1.613613113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:10:53.611519844 +0000 UTC m=+1923.842765034" watchObservedRunningTime="2026-07-06 18:10:53.613613113 +0000 UTC m=+1923.844858350" Jul 06 18:10:54.595764 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:54.595725 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:54.596837 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:54.596814 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:10:55.554054 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:55.554003 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:55.639163 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:55.639130 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:55.722460 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:55.722428 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:55.821671 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:55.821572 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:56.244803 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:56.244773 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:10:56.353446 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:10:56.353411 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:00.083752 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.083716 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:00.412268 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.412181 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:00.703816 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.703783 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5"] Jul 06 18:11:00.704157 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.704143 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" Jul 06 18:11:00.704221 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.704158 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8ffcb69-f346-4587-8131-f97e47255e69" containerName="istio-proxy" Jul 06 18:11:00.706524 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.706503 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.709271 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.709248 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3168b2-openshift-default-dockercfg-xrpcg\"" Jul 06 18:11:00.718979 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.718954 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5"] Jul 06 18:11:00.735254 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.735216 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:00.886089 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.886046 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-data\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.886089 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.886088 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istiod-ca-cert\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.886363 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.886186 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-token\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.886363 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.886212 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjlvq\" (UniqueName: \"kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-kube-api-access-fjlvq\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.886363 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.886249 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-certs\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.886363 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.886305 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-envoy\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.886363 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.886335 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-socket\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.886550 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.886397 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-podinfo\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.886550 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.886431 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-credential-socket\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987346 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987245 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-podinfo\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987346 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987294 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-credential-socket\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987589 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987417 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-data\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987589 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987451 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istiod-ca-cert\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987589 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987539 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-token\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987791 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987638 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjlvq\" (UniqueName: \"kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-kube-api-access-fjlvq\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987791 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987732 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-credential-socket\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987791 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987748 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-certs\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987951 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987783 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-data\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987951 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987856 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-envoy\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.987951 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.987922 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-socket\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.988129 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.988003 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-certs\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.988244 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.988220 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-socket\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.988348 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.988244 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istiod-ca-cert\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.989999 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.989973 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-envoy\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.990229 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.990208 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-podinfo\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.996988 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.996959 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-token\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:00.997178 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:00.997157 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjlvq\" (UniqueName: \"kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-kube-api-access-fjlvq\") pod \"e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:01.018080 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:01.018047 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:01.160790 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:01.160761 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5"] Jul 06 18:11:01.163349 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:11:01.163319 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb7ce96_f36e_4bbd_a578_e1eb3260b5d0.slice/crio-0e9c5159711f12258080dbb432761794b3e4ca153c324beed9298b4deaf4b278 WatchSource:0}: Error finding container 0e9c5159711f12258080dbb432761794b3e4ca153c324beed9298b4deaf4b278: Status 404 returned error can't find the container with id 0e9c5159711f12258080dbb432761794b3e4ca153c324beed9298b4deaf4b278 Jul 06 18:11:01.165640 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:01.165610 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:11:01.165737 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:01.165675 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:11:01.165737 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:01.165728 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:11:01.631769 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:01.631736 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" event={"ID":"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0","Type":"ContainerStarted","Data":"fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5"} Jul 06 18:11:01.631944 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:01.631783 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" event={"ID":"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0","Type":"ContainerStarted","Data":"0e9c5159711f12258080dbb432761794b3e4ca153c324beed9298b4deaf4b278"} Jul 06 18:11:01.656115 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:01.656064 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" podStartSLOduration=1.656050381 podStartE2EDuration="1.656050381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:11:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:11:01.654830864 +0000 UTC m=+1931.886076041" watchObservedRunningTime="2026-07-06 18:11:01.656050381 +0000 UTC m=+1931.887295556" Jul 06 18:11:01.672878 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:01.672850 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:02.018499 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:02.018468 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:02.023073 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:02.023052 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:02.637326 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:02.637295 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:02.638297 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:02.638279 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:03.580827 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:03.580797 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:03.652277 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:03.652249 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:03.713350 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:03.713324 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:04.059422 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:04.059380 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:04.267777 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:04.267743 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:04.369240 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:04.369146 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:08.080323 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:08.080290 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:10.638982 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:10.638934 2539 patch_prober.go:28] interesting pod/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 18:11:10.639618 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:10.639582 2539 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 18:11:11.689384 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:11.689349 2539 generic.go:356] "Generic (PLEG): container finished" podID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerID="5446c0f753610b91fb07dd3f023673592b56435e3f9c5ea276e756b0ccc63386" exitCode=0 Jul 06 18:11:11.689821 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:11.689418 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" event={"ID":"4f927b6a-09ba-4da3-b51a-c1317a62eb3c","Type":"ContainerDied","Data":"5446c0f753610b91fb07dd3f023673592b56435e3f9c5ea276e756b0ccc63386"} Jul 06 18:11:11.689821 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:11.689811 2539 scope.go:117] "RemoveContainer" containerID="5446c0f753610b91fb07dd3f023673592b56435e3f9c5ea276e756b0ccc63386" Jul 06 18:11:11.690847 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:11.690822 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:11:11.690919 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:11.690888 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:11:11.690919 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:11.690916 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:11:12.699103 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:12.699065 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" event={"ID":"4f927b6a-09ba-4da3-b51a-c1317a62eb3c","Type":"ContainerStarted","Data":"db98547d831b08f9a8f1b690125350534cf415aed0d3ef22371ccd699c3c1662"} Jul 06 18:11:13.597169 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:13.597131 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:11:13.601040 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:13.600926 2539 patch_prober.go:28] interesting pod/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 06 18:11:13.601040 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:13.600987 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 06 18:11:13.810732 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:13.808571 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:14.596860 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:14.596823 2539 patch_prober.go:28] interesting pod/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 06 18:11:14.597154 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:14.597126 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 06 18:11:15.597650 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:15.597609 2539 patch_prober.go:28] interesting pod/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 06 18:11:15.598240 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:15.598204 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 06 18:11:16.600342 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:16.600303 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:11:16.600835 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:16.600575 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:11:16.601287 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:16.601268 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:11:17.216590 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:17.216556 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:17.317419 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:17.317388 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:17.836990 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:17.836846 2539 patch_prober.go:28] interesting pod/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": read tcp 10.134.0.2:38208->10.134.0.46:15021: read: connection reset by peer" start-of-body= Jul 06 18:11:17.836990 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:17.836912 2539 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": read tcp 10.134.0.2:38208->10.134.0.46:15021: read: connection reset by peer" Jul 06 18:11:18.738460 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:18.738425 2539 generic.go:356] "Generic (PLEG): container finished" podID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerID="fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5" exitCode=0 Jul 06 18:11:18.738626 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:18.738497 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" event={"ID":"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0","Type":"ContainerDied","Data":"fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5"} Jul 06 18:11:18.738911 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:18.738898 2539 scope.go:117] "RemoveContainer" containerID="fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5" Jul 06 18:11:18.739948 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:18.739922 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:11:18.740018 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:18.739989 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:11:18.740056 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:18.740016 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:11:19.752037 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:19.752003 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" event={"ID":"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0","Type":"ContainerStarted","Data":"0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3"} Jul 06 18:11:20.019098 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:20.019003 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:20.019280 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:20.019220 2539 patch_prober.go:28] interesting pod/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 06 18:11:20.019419 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:20.019280 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 06 18:11:21.018634 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:21.018592 2539 patch_prober.go:28] interesting pod/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 06 18:11:21.019078 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:21.018654 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 06 18:11:22.018608 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:22.018575 2539 patch_prober.go:28] interesting pod/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 06 18:11:22.018810 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:22.018639 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 06 18:11:23.019222 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:23.019185 2539 patch_prober.go:28] interesting pod/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 06 18:11:23.019748 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:23.019260 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 06 18:11:24.021897 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:24.021865 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:24.022336 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:24.022128 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:24.022909 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:24.022891 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:11:24.966969 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:24.966934 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:25.067907 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:25.067850 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:35.118049 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:35.118012 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:56.368804 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:56.368726 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:57.286523 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:57.286489 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:57.446314 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:57.446283 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:57.859427 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:57.859393 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:57.976893 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:57.976848 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:58.060450 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:58.060413 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:11:58.135626 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:11:58.135544 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:02.928790 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:02.928745 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:36.305373 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:36.305342 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:39.677179 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:39.677108 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:40.010253 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:40.010173 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv"] Jul 06 18:12:40.010404 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:40.010364 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" containerID="cri-o://db98547d831b08f9a8f1b690125350534cf415aed0d3ef22371ccd699c3c1662" gracePeriod=30 Jul 06 18:12:40.031962 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:40.031935 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:40.222091 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:40.222050 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:40.397047 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:40.396971 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:40.846577 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:40.846549 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:41.045801 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:41.045678 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:41.141930 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:41.141853 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:41.295827 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:41.295777 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:45.189690 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.189660 2539 generic.go:356] "Generic (PLEG): container finished" podID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerID="db98547d831b08f9a8f1b690125350534cf415aed0d3ef22371ccd699c3c1662" exitCode=0 Jul 06 18:12:45.190124 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.189736 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" event={"ID":"4f927b6a-09ba-4da3-b51a-c1317a62eb3c","Type":"ContainerDied","Data":"db98547d831b08f9a8f1b690125350534cf415aed0d3ef22371ccd699c3c1662"} Jul 06 18:12:45.190124 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.189796 2539 scope.go:117] "RemoveContainer" containerID="5446c0f753610b91fb07dd3f023673592b56435e3f9c5ea276e756b0ccc63386" Jul 06 18:12:45.261428 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.261403 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:12:45.405765 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.405672 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-socket\") pod \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " Jul 06 18:12:45.405765 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.405735 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-envoy\") pod \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " Jul 06 18:12:45.405765 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.405756 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-podinfo\") pod \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " Jul 06 18:12:45.406024 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.405780 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istiod-ca-cert\") pod \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " Jul 06 18:12:45.406024 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.405797 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-token\") pod \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " Jul 06 18:12:45.406024 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.405826 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-certs\") pod \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " Jul 06 18:12:45.406024 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.405872 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-data\") pod \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " Jul 06 18:12:45.406024 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.405923 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxrvg\" (UniqueName: \"kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-kube-api-access-bxrvg\") pod \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " Jul 06 18:12:45.406024 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.405950 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-credential-socket\") pod \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\" (UID: \"4f927b6a-09ba-4da3-b51a-c1317a62eb3c\") " Jul 06 18:12:45.406329 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.406098 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f927b6a-09ba-4da3-b51a-c1317a62eb3c" (UID: "4f927b6a-09ba-4da3-b51a-c1317a62eb3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:12:45.406329 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.406150 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f927b6a-09ba-4da3-b51a-c1317a62eb3c" (UID: "4f927b6a-09ba-4da3-b51a-c1317a62eb3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:12:45.406329 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.406261 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f927b6a-09ba-4da3-b51a-c1317a62eb3c" (UID: "4f927b6a-09ba-4da3-b51a-c1317a62eb3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:12:45.406329 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.406280 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:45.406329 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.406298 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:45.406329 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.406299 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f927b6a-09ba-4da3-b51a-c1317a62eb3c" (UID: "4f927b6a-09ba-4da3-b51a-c1317a62eb3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:12:45.406995 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.406968 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f927b6a-09ba-4da3-b51a-c1317a62eb3c" (UID: "4f927b6a-09ba-4da3-b51a-c1317a62eb3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:12:45.408239 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.408209 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f927b6a-09ba-4da3-b51a-c1317a62eb3c" (UID: "4f927b6a-09ba-4da3-b51a-c1317a62eb3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:12:45.408336 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.408246 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-kube-api-access-bxrvg" (OuterVolumeSpecName: "kube-api-access-bxrvg") pod "4f927b6a-09ba-4da3-b51a-c1317a62eb3c" (UID: "4f927b6a-09ba-4da3-b51a-c1317a62eb3c"). InnerVolumeSpecName "kube-api-access-bxrvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:12:45.408336 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.408262 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f927b6a-09ba-4da3-b51a-c1317a62eb3c" (UID: "4f927b6a-09ba-4da3-b51a-c1317a62eb3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:12:45.408667 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.408653 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f927b6a-09ba-4da3-b51a-c1317a62eb3c" (UID: "4f927b6a-09ba-4da3-b51a-c1317a62eb3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:12:45.507211 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.507191 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:45.507211 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.507210 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:45.507332 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.507219 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:45.507332 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.507228 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:45.507332 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.507235 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:45.507332 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.507242 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxrvg\" (UniqueName: \"kubernetes.io/projected/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-kube-api-access-bxrvg\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:45.507332 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:45.507253 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f927b6a-09ba-4da3-b51a-c1317a62eb3c-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:46.195991 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.195958 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" event={"ID":"4f927b6a-09ba-4da3-b51a-c1317a62eb3c","Type":"ContainerDied","Data":"3de8b43295ab0838388bcbc50e944d4af105a3189d111e085b42af03c6d1792c"} Jul 06 18:12:46.195991 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.195975 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv" Jul 06 18:12:46.196442 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.196039 2539 scope.go:117] "RemoveContainer" containerID="db98547d831b08f9a8f1b690125350534cf415aed0d3ef22371ccd699c3c1662" Jul 06 18:12:46.220540 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.220509 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv"] Jul 06 18:12:46.222671 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.222650 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-b635d0-openshift-default-588b6dffc-p28dv"] Jul 06 18:12:46.304526 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.304497 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" path="/var/lib/kubelet/pods/4f927b6a-09ba-4da3-b51a-c1317a62eb3c/volumes" Jul 06 18:12:46.554651 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.554568 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:46.658410 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.658373 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:46.806744 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.806644 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5"] Jul 06 18:12:46.806958 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.806926 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" containerID="cri-o://0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3" gracePeriod=30 Jul 06 18:12:46.831107 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:46.831084 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:47.071588 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.071480 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:47.442264 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.442228 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:47.740682 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.740601 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp"] Jul 06 18:12:47.740981 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.740966 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" Jul 06 18:12:47.741042 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.740984 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" Jul 06 18:12:47.741042 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.740994 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" Jul 06 18:12:47.741042 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.740999 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" Jul 06 18:12:47.741138 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.741071 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" Jul 06 18:12:47.741138 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.741082 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f927b6a-09ba-4da3-b51a-c1317a62eb3c" containerName="istio-proxy" Jul 06 18:12:47.744342 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.744324 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.747187 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.747168 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-453d8d-openshift-default-dockercfg-zdqzv\"" Jul 06 18:12:47.756339 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.756313 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp"] Jul 06 18:12:47.760685 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.760664 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:47.826224 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.826189 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b244556-a7ac-4f06-93ba-e3022f9813d6-istiod-ca-cert\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.826364 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.826264 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-credential-socket\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.826364 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.826317 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-certs\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.826502 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.826446 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-socket\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.826502 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.826477 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-data\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.826606 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.826516 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-podinfo\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.826606 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.826586 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-token\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.826755 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.826629 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chslh\" (UniqueName: \"kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-kube-api-access-chslh\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.826755 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.826668 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-envoy\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.927524 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.927487 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chslh\" (UniqueName: \"kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-kube-api-access-chslh\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.927524 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.927522 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-envoy\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.927808 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.927738 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b244556-a7ac-4f06-93ba-e3022f9813d6-istiod-ca-cert\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.927808 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.927788 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-credential-socket\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.927928 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.927814 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-certs\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.927928 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.927879 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-socket\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.927928 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.927915 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-data\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.928081 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.927938 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-podinfo\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.928081 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.927996 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-token\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.928192 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.928172 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-credential-socket\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.928244 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.928211 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-certs\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.928344 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.928324 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-socket\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.928541 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.928519 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b244556-a7ac-4f06-93ba-e3022f9813d6-istiod-ca-cert\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.928642 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.928554 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-data\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.929918 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.929900 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-envoy\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.930392 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.930375 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-podinfo\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.935629 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.935608 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-token\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:47.936326 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:47.936310 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chslh\" (UniqueName: \"kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-kube-api-access-chslh\") pod \"e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:48.035668 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:48.035577 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:48.054879 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:48.054856 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:48.193548 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:48.193524 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp"] Jul 06 18:12:48.195425 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:12:48.195390 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b244556_a7ac_4f06_93ba_e3022f9813d6.slice/crio-ba4ff2263e2e50b8d56e61a2b4df6b2a0c5c8133d12f607b38105368557d28a3 WatchSource:0}: Error finding container ba4ff2263e2e50b8d56e61a2b4df6b2a0c5c8133d12f607b38105368557d28a3: Status 404 returned error can't find the container with id ba4ff2263e2e50b8d56e61a2b4df6b2a0c5c8133d12f607b38105368557d28a3 Jul 06 18:12:48.197387 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:48.197358 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:12:48.197467 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:48.197415 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:12:48.197467 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:48.197440 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:12:48.208752 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:48.208726 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" event={"ID":"4b244556-a7ac-4f06-93ba-e3022f9813d6","Type":"ContainerStarted","Data":"ba4ff2263e2e50b8d56e61a2b4df6b2a0c5c8133d12f607b38105368557d28a3"} Jul 06 18:12:49.215431 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:49.215393 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" event={"ID":"4b244556-a7ac-4f06-93ba-e3022f9813d6","Type":"ContainerStarted","Data":"c6cf928e80df6544daac071b0da7bc98870bfc644e9743b13b427d0138bf4b82"} Jul 06 18:12:49.236805 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:49.236755 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" podStartSLOduration=2.236740626 podStartE2EDuration="2.236740626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:12:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:12:49.235781242 +0000 UTC m=+2039.467026419" watchObservedRunningTime="2026-07-06 18:12:49.236740626 +0000 UTC m=+2039.467985800" Jul 06 18:12:50.055032 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:50.055006 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:50.059723 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:50.059682 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:50.223876 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:50.223837 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:50.225083 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:50.225062 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:12:51.152906 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:51.152864 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:51.226999 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:51.226967 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:51.302490 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:51.302451 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:51.403836 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:51.403738 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:51.708924 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:51.708889 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:51.809917 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:51.809887 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:52.057137 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.057115 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:12:52.167717 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.167668 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-credential-socket\") pod \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " Jul 06 18:12:52.167853 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.167747 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-envoy\") pod \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " Jul 06 18:12:52.167853 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.167776 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-socket\") pod \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " Jul 06 18:12:52.167853 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.167795 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjlvq\" (UniqueName: \"kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-kube-api-access-fjlvq\") pod \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " Jul 06 18:12:52.167853 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.167831 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-token\") pod \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " Jul 06 18:12:52.168063 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.167858 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-certs\") pod \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " Jul 06 18:12:52.168063 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.167889 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istiod-ca-cert\") pod \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " Jul 06 18:12:52.168063 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.167922 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-data\") pod \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " Jul 06 18:12:52.168063 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.167950 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" (UID: "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:12:52.168063 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.167976 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-podinfo\") pod \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\" (UID: \"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0\") " Jul 06 18:12:52.168063 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.168056 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" (UID: "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:12:52.168365 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.168265 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" (UID: "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:12:52.168365 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.168328 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:52.168365 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.168346 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:52.168798 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.168761 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" (UID: "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:12:52.168968 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.168937 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" (UID: "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:12:52.170084 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.170060 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" (UID: "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:12:52.170084 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.170072 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" (UID: "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:12:52.170231 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.170158 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-kube-api-access-fjlvq" (OuterVolumeSpecName: "kube-api-access-fjlvq") pod "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" (UID: "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0"). InnerVolumeSpecName "kube-api-access-fjlvq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:12:52.170231 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.170183 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" (UID: "4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:12:52.234482 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.234426 2539 generic.go:356] "Generic (PLEG): container finished" podID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerID="0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3" exitCode=0 Jul 06 18:12:52.234482 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.234477 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" Jul 06 18:12:52.234925 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.234518 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" event={"ID":"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0","Type":"ContainerDied","Data":"0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3"} Jul 06 18:12:52.234925 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.234580 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5" event={"ID":"4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0","Type":"ContainerDied","Data":"0e9c5159711f12258080dbb432761794b3e4ca153c324beed9298b4deaf4b278"} Jul 06 18:12:52.234925 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.234614 2539 scope.go:117] "RemoveContainer" containerID="0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3" Jul 06 18:12:52.243442 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.243424 2539 scope.go:117] "RemoveContainer" containerID="fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5" Jul 06 18:12:52.251344 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.251329 2539 scope.go:117] "RemoveContainer" containerID="0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3" Jul 06 18:12:52.251605 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:12:52.251587 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3\": container with ID starting with 0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3 not found: ID does not exist" containerID="0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3" Jul 06 18:12:52.251660 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.251613 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3"} err="failed to get container status \"0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3\": rpc error: code = NotFound desc = could not find container \"0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3\": container with ID starting with 0cf74e53b4df4e21ea512dd9e2f86ea908a9f0cb5bf26d1cd1ae0027b82018c3 not found: ID does not exist" Jul 06 18:12:52.251660 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.251628 2539 scope.go:117] "RemoveContainer" containerID="fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5" Jul 06 18:12:52.251872 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:12:52.251853 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5\": container with ID starting with fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5 not found: ID does not exist" containerID="fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5" Jul 06 18:12:52.251922 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.251878 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5"} err="failed to get container status \"fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5\": rpc error: code = NotFound desc = could not find container \"fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5\": container with ID starting with fe63b38cd153ed0f9b53c9c7d69f64193282568d645376b41a43c746f14174f5 not found: ID does not exist" Jul 06 18:12:52.258013 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.257993 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5"] Jul 06 18:12:52.264156 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.264134 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3168b2-openshift-default-84b89d8859-2c5b5"] Jul 06 18:12:52.269712 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.269682 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:52.269795 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.269718 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:52.269795 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.269732 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjlvq\" (UniqueName: \"kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-kube-api-access-fjlvq\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:52.269795 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.269741 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:52.269795 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.269750 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:52.269795 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.269757 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:52.269795 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.269765 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:12:52.303516 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:52.303492 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" path="/var/lib/kubelet/pods/4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0/volumes" Jul 06 18:12:55.694828 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:55.694772 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:56.167511 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.167425 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:56.449047 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.449009 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt"] Jul 06 18:12:56.449515 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.449500 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" Jul 06 18:12:56.449560 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.449519 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" Jul 06 18:12:56.449560 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.449551 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" Jul 06 18:12:56.449628 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.449561 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" Jul 06 18:12:56.449661 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.449645 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" Jul 06 18:12:56.449661 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.449658 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb7ce96-f36e-4bbd-a578-e1eb3260b5d0" containerName="istio-proxy" Jul 06 18:12:56.452552 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.452531 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.455236 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.455218 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f63d8f-openshift-default-dockercfg-p28fj\"" Jul 06 18:12:56.463011 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.462990 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt"] Jul 06 18:12:56.473408 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.473387 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:56.508606 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.508575 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/567d5ac4-76b0-4c66-b415-a5654da2f396-istiod-ca-cert\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.508753 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.508615 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-socket\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.508753 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.508633 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-credential-socket\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.508851 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.508752 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-token\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.508851 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.508785 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vs78\" (UniqueName: \"kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-kube-api-access-2vs78\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.508851 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.508808 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-envoy\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.508851 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.508834 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-certs\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.508970 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.508892 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-data\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.508970 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.508910 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-podinfo\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610214 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610183 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-socket\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610375 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610220 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-credential-socket\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610375 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610256 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-token\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610375 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610273 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vs78\" (UniqueName: \"kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-kube-api-access-2vs78\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610375 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610298 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-envoy\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610375 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610331 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-certs\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610633 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610382 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-data\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610633 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610409 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-podinfo\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610633 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610480 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/567d5ac4-76b0-4c66-b415-a5654da2f396-istiod-ca-cert\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610814 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610643 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-socket\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610814 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610657 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-credential-socket\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610903 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610818 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-certs\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.610903 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.610842 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-data\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.611191 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.611173 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/567d5ac4-76b0-4c66-b415-a5654da2f396-istiod-ca-cert\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.612858 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.612835 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-envoy\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.613010 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.612996 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-podinfo\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.621640 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.621617 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-token\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.621894 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.621868 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vs78\" (UniqueName: \"kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-kube-api-access-2vs78\") pod \"e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.657060 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.657034 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:56.763974 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.763887 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:56.897129 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.897098 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt"] Jul 06 18:12:56.898426 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:12:56.898402 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod567d5ac4_76b0_4c66_b415_a5654da2f396.slice/crio-6a9fd985e0a91f23c02a21aa8ebb6aaea61f38332aef5444623ab8124d2c381c WatchSource:0}: Error finding container 6a9fd985e0a91f23c02a21aa8ebb6aaea61f38332aef5444623ab8124d2c381c: Status 404 returned error can't find the container with id 6a9fd985e0a91f23c02a21aa8ebb6aaea61f38332aef5444623ab8124d2c381c Jul 06 18:12:56.900565 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.900534 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:12:56.900623 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.900597 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:12:56.900659 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:56.900625 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:12:57.262090 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:57.262049 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" event={"ID":"567d5ac4-76b0-4c66-b415-a5654da2f396","Type":"ContainerStarted","Data":"90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47"} Jul 06 18:12:57.262241 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:57.262109 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" event={"ID":"567d5ac4-76b0-4c66-b415-a5654da2f396","Type":"ContainerStarted","Data":"6a9fd985e0a91f23c02a21aa8ebb6aaea61f38332aef5444623ab8124d2c381c"} Jul 06 18:12:57.289924 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:57.289876 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" podStartSLOduration=1.289861619 podStartE2EDuration="1.289861619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:12:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:12:57.28801934 +0000 UTC m=+2047.519264517" watchObservedRunningTime="2026-07-06 18:12:57.289861619 +0000 UTC m=+2047.521106793" Jul 06 18:12:57.764666 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:57.764637 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:57.769359 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:57.769328 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:58.267064 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:58.267025 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:58.268052 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:58.268030 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:12:59.312188 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:59.312142 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:59.395093 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:59.395051 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:59.534292 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:59.534262 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:12:59.853169 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:12:59.853138 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:00.061629 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:00.061594 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:00.162025 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:00.161944 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:03.726476 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:03.726436 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:04.300157 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:04.300125 2539 generic.go:356] "Generic (PLEG): container finished" podID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerID="c6cf928e80df6544daac071b0da7bc98870bfc644e9743b13b427d0138bf4b82" exitCode=0 Jul 06 18:13:04.303973 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:04.303953 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" event={"ID":"4b244556-a7ac-4f06-93ba-e3022f9813d6","Type":"ContainerDied","Data":"c6cf928e80df6544daac071b0da7bc98870bfc644e9743b13b427d0138bf4b82"} Jul 06 18:13:04.304308 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:04.304293 2539 scope.go:117] "RemoveContainer" containerID="c6cf928e80df6544daac071b0da7bc98870bfc644e9743b13b427d0138bf4b82" Jul 06 18:13:04.305254 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:04.305227 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:04.305326 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:04.305309 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:04.305373 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:04.305357 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:05.224031 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:05.223999 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:13:05.310767 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:05.310731 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" event={"ID":"4b244556-a7ac-4f06-93ba-e3022f9813d6","Type":"ContainerStarted","Data":"5f7666a6dafc5ed3466918ab686e0e2f7d807addd078531e74c62a1a7a9b70c3"} Jul 06 18:13:06.056006 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:06.055965 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:13:06.056980 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:06.056957 2539 patch_prober.go:28] interesting pod/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 06 18:13:06.057104 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:06.057019 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 06 18:13:07.055516 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:07.055464 2539 patch_prober.go:28] interesting pod/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 06 18:13:07.056109 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:07.055529 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 06 18:13:08.055966 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:08.055931 2539 patch_prober.go:28] interesting pod/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 06 18:13:08.056364 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:08.055982 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 06 18:13:09.056030 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:09.055989 2539 patch_prober.go:28] interesting pod/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 06 18:13:09.056412 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:09.056057 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 06 18:13:10.059902 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:10.059867 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:13:10.060285 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:10.060124 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:13:10.060854 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:10.060839 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:13:11.866017 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:11.865972 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:12.283742 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:12.279667 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:12.387299 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:12.387268 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:12.487692 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:12.487657 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:12.649631 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:12.649549 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:13.534506 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:13.534478 2539 patch_prober.go:28] interesting pod/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": read tcp 10.134.0.2:48166->10.134.0.48:15021: read: connection reset by peer" start-of-body= Jul 06 18:13:13.534926 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:13.534547 2539 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": read tcp 10.134.0.2:48166->10.134.0.48:15021: read: connection reset by peer" Jul 06 18:13:14.365176 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:14.365146 2539 generic.go:356] "Generic (PLEG): container finished" podID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerID="90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47" exitCode=0 Jul 06 18:13:14.365345 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:14.365207 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" event={"ID":"567d5ac4-76b0-4c66-b415-a5654da2f396","Type":"ContainerDied","Data":"90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47"} Jul 06 18:13:14.365566 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:14.365552 2539 scope.go:117] "RemoveContainer" containerID="90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47" Jul 06 18:13:14.366534 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:14.366506 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:14.366607 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:14.366590 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:14.366649 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:14.366635 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:15.372739 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:15.372687 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" event={"ID":"567d5ac4-76b0-4c66-b415-a5654da2f396","Type":"ContainerStarted","Data":"842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922"} Jul 06 18:13:15.764377 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:15.764340 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:13:15.764558 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:15.764533 2539 patch_prober.go:28] interesting pod/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 06 18:13:15.764603 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:15.764584 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 06 18:13:16.764502 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:16.764467 2539 patch_prober.go:28] interesting pod/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 06 18:13:16.764905 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:16.764531 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 06 18:13:17.764363 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:17.764325 2539 patch_prober.go:28] interesting pod/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 06 18:13:17.764539 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:17.764382 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 06 18:13:17.919838 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:17.919805 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:17.991099 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:17.991069 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:18.160673 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:18.160593 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp"] Jul 06 18:13:18.160858 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:18.160835 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" containerID="cri-o://5f7666a6dafc5ed3466918ab686e0e2f7d807addd078531e74c62a1a7a9b70c3" gracePeriod=30 Jul 06 18:13:18.200300 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:18.200262 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:18.419752 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:18.419654 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:18.584658 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:18.584630 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:18.765183 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:18.765148 2539 patch_prober.go:28] interesting pod/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 06 18:13:18.765580 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:18.765215 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 06 18:13:18.977804 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:18.977775 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:19.080731 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:19.080622 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:19.178935 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:19.178905 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:19.292125 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:19.292096 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:19.768175 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:19.768145 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:13:19.768543 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:19.768476 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:13:19.769153 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:19.769137 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:13:21.080442 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:21.080406 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:21.184420 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:21.184393 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:23.412364 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.412338 2539 generic.go:356] "Generic (PLEG): container finished" podID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerID="5f7666a6dafc5ed3466918ab686e0e2f7d807addd078531e74c62a1a7a9b70c3" exitCode=0 Jul 06 18:13:23.412671 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.412400 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" event={"ID":"4b244556-a7ac-4f06-93ba-e3022f9813d6","Type":"ContainerDied","Data":"5f7666a6dafc5ed3466918ab686e0e2f7d807addd078531e74c62a1a7a9b70c3"} Jul 06 18:13:23.412671 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.412452 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" event={"ID":"4b244556-a7ac-4f06-93ba-e3022f9813d6","Type":"ContainerDied","Data":"ba4ff2263e2e50b8d56e61a2b4df6b2a0c5c8133d12f607b38105368557d28a3"} Jul 06 18:13:23.412671 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.412471 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ba4ff2263e2e50b8d56e61a2b4df6b2a0c5c8133d12f607b38105368557d28a3" Jul 06 18:13:23.412671 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.412485 2539 scope.go:117] "RemoveContainer" containerID="c6cf928e80df6544daac071b0da7bc98870bfc644e9743b13b427d0138bf4b82" Jul 06 18:13:23.417101 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.416106 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:13:23.485683 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.485657 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-socket\") pod \"4b244556-a7ac-4f06-93ba-e3022f9813d6\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " Jul 06 18:13:23.485838 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.485741 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-certs\") pod \"4b244556-a7ac-4f06-93ba-e3022f9813d6\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " Jul 06 18:13:23.485838 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.485776 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b244556-a7ac-4f06-93ba-e3022f9813d6-istiod-ca-cert\") pod \"4b244556-a7ac-4f06-93ba-e3022f9813d6\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " Jul 06 18:13:23.485838 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.485804 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-data\") pod \"4b244556-a7ac-4f06-93ba-e3022f9813d6\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " Jul 06 18:13:23.486002 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.485872 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-credential-socket\") pod \"4b244556-a7ac-4f06-93ba-e3022f9813d6\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " Jul 06 18:13:23.486002 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.485915 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-token\") pod \"4b244556-a7ac-4f06-93ba-e3022f9813d6\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " Jul 06 18:13:23.486002 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.485930 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4b244556-a7ac-4f06-93ba-e3022f9813d6" (UID: "4b244556-a7ac-4f06-93ba-e3022f9813d6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:13:23.486002 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.485964 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chslh\" (UniqueName: \"kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-kube-api-access-chslh\") pod \"4b244556-a7ac-4f06-93ba-e3022f9813d6\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " Jul 06 18:13:23.486185 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.486009 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-podinfo\") pod \"4b244556-a7ac-4f06-93ba-e3022f9813d6\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " Jul 06 18:13:23.486185 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.486040 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-envoy\") pod \"4b244556-a7ac-4f06-93ba-e3022f9813d6\" (UID: \"4b244556-a7ac-4f06-93ba-e3022f9813d6\") " Jul 06 18:13:23.486185 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.486026 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4b244556-a7ac-4f06-93ba-e3022f9813d6" (UID: "4b244556-a7ac-4f06-93ba-e3022f9813d6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:13:23.486185 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.486156 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4b244556-a7ac-4f06-93ba-e3022f9813d6" (UID: "4b244556-a7ac-4f06-93ba-e3022f9813d6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:13:23.486333 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.486200 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b244556-a7ac-4f06-93ba-e3022f9813d6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4b244556-a7ac-4f06-93ba-e3022f9813d6" (UID: "4b244556-a7ac-4f06-93ba-e3022f9813d6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:13:23.486403 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.486383 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:23.486457 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.486409 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:23.486457 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.486424 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b244556-a7ac-4f06-93ba-e3022f9813d6-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:23.486457 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.486435 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:23.486803 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.486779 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-data" (OuterVolumeSpecName: "istio-data") pod "4b244556-a7ac-4f06-93ba-e3022f9813d6" (UID: "4b244556-a7ac-4f06-93ba-e3022f9813d6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:13:23.488127 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.488092 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-token" (OuterVolumeSpecName: "istio-token") pod "4b244556-a7ac-4f06-93ba-e3022f9813d6" (UID: "4b244556-a7ac-4f06-93ba-e3022f9813d6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:13:23.488216 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.488176 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4b244556-a7ac-4f06-93ba-e3022f9813d6" (UID: "4b244556-a7ac-4f06-93ba-e3022f9813d6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:13:23.488608 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.488587 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4b244556-a7ac-4f06-93ba-e3022f9813d6" (UID: "4b244556-a7ac-4f06-93ba-e3022f9813d6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:13:23.488666 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.488614 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-kube-api-access-chslh" (OuterVolumeSpecName: "kube-api-access-chslh") pod "4b244556-a7ac-4f06-93ba-e3022f9813d6" (UID: "4b244556-a7ac-4f06-93ba-e3022f9813d6"). InnerVolumeSpecName "kube-api-access-chslh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:13:23.587345 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.587322 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:23.587345 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.587344 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chslh\" (UniqueName: \"kubernetes.io/projected/4b244556-a7ac-4f06-93ba-e3022f9813d6-kube-api-access-chslh\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:23.587477 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.587354 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:23.587477 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.587361 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:23.587477 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:23.587369 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b244556-a7ac-4f06-93ba-e3022f9813d6-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:24.418870 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:24.418838 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp" Jul 06 18:13:24.451951 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:24.451919 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp"] Jul 06 18:13:24.456311 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:24.456284 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-453d8d-openshift-default-5f5fdcd6f9-pl6cp"] Jul 06 18:13:24.747047 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:24.747003 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:24.846945 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:24.846912 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:25.002194 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.002114 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt"] Jul 06 18:13:25.002393 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.002346 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" containerID="cri-o://842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922" gracePeriod=30 Jul 06 18:13:25.025196 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.025127 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:25.272028 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.271949 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:25.587322 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.587249 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:25.880155 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.880056 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs"] Jul 06 18:13:25.880461 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.880443 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" Jul 06 18:13:25.880461 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.880463 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" Jul 06 18:13:25.880601 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.880527 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" Jul 06 18:13:25.883643 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.883625 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:25.886174 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.886156 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-3b0a18-openshift-default-dockercfg-hrpzt\"" Jul 06 18:13:25.895817 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.895795 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs"] Jul 06 18:13:25.904585 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:25.904551 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:26.010102 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.010070 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10263309-514b-4866-85bb-77ffae7c6bc2-istio-podinfo\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.010277 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.010118 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-envoy\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.010277 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.010143 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7x4z\" (UniqueName: \"kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-kube-api-access-q7x4z\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.010277 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.010223 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-credential-socket\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.010277 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.010261 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10263309-514b-4866-85bb-77ffae7c6bc2-istiod-ca-cert\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.010413 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.010289 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-istio-token\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.010413 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.010308 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-socket\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.010413 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.010342 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-data\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.010413 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.010361 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-certs\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111154 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111120 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-data\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111154 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111157 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-certs\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111391 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111195 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10263309-514b-4866-85bb-77ffae7c6bc2-istio-podinfo\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111391 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111222 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-envoy\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111391 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111241 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7x4z\" (UniqueName: \"kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-kube-api-access-q7x4z\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111391 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111266 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-credential-socket\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111391 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111288 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10263309-514b-4866-85bb-77ffae7c6bc2-istiod-ca-cert\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111391 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111323 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-istio-token\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111391 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111351 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-socket\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111754 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111575 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-certs\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111754 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111610 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-data\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111846 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111756 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-socket\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.111953 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.111931 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-credential-socket\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.112041 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.112025 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10263309-514b-4866-85bb-77ffae7c6bc2-istiod-ca-cert\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.114112 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.114088 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-envoy\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.114311 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.114295 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10263309-514b-4866-85bb-77ffae7c6bc2-istio-podinfo\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.119817 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.119793 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-istio-token\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.120258 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.120237 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7x4z\" (UniqueName: \"kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-kube-api-access-q7x4z\") pod \"e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.195118 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.195092 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:26.304058 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.304029 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" path="/var/lib/kubelet/pods/4b244556-a7ac-4f06-93ba-e3022f9813d6/volumes" Jul 06 18:13:26.332471 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.332448 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs"] Jul 06 18:13:26.334289 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:13:26.334248 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10263309_514b_4866_85bb_77ffae7c6bc2.slice/crio-275f18a5beb4d68eb8e024afb92601daeeeb5d576ddd49d2a00cf250d4bf5c8c WatchSource:0}: Error finding container 275f18a5beb4d68eb8e024afb92601daeeeb5d576ddd49d2a00cf250d4bf5c8c: Status 404 returned error can't find the container with id 275f18a5beb4d68eb8e024afb92601daeeeb5d576ddd49d2a00cf250d4bf5c8c Jul 06 18:13:26.337121 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.336776 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:26.337121 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.336864 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:26.337121 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.336904 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:26.366357 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.366289 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:26.439544 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.439497 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" event={"ID":"10263309-514b-4866-85bb-77ffae7c6bc2","Type":"ContainerStarted","Data":"aacad01b9dd69fe856c917be43fce768f5cf53ed5c20fa297b53a39b65866936"} Jul 06 18:13:26.439753 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.439602 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" event={"ID":"10263309-514b-4866-85bb-77ffae7c6bc2","Type":"ContainerStarted","Data":"275f18a5beb4d68eb8e024afb92601daeeeb5d576ddd49d2a00cf250d4bf5c8c"} Jul 06 18:13:26.460441 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:26.460343 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" podStartSLOduration=1.460329018 podStartE2EDuration="1.460329018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:13:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:13:26.459510005 +0000 UTC m=+2076.690755181" watchObservedRunningTime="2026-07-06 18:13:26.460329018 +0000 UTC m=+2076.691574191" Jul 06 18:13:27.195982 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:27.195939 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:27.197231 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:27.197207 2539 patch_prober.go:28] interesting pod/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 06 18:13:27.197324 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:27.197267 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 06 18:13:28.199819 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:28.199792 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:28.416077 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:28.416032 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:28.449878 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:28.449802 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:28.450930 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:28.450905 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:28.492116 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:28.492071 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:28.568517 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:28.568480 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:28.872920 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:28.872831 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:29.052042 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:29.052011 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:29.153168 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:29.153095 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:30.247032 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.247013 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:13:30.350916 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.350853 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-podinfo\") pod \"567d5ac4-76b0-4c66-b415-a5654da2f396\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " Jul 06 18:13:30.350916 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.350914 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/567d5ac4-76b0-4c66-b415-a5654da2f396-istiod-ca-cert\") pod \"567d5ac4-76b0-4c66-b415-a5654da2f396\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " Jul 06 18:13:30.351094 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.350933 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-socket\") pod \"567d5ac4-76b0-4c66-b415-a5654da2f396\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " Jul 06 18:13:30.351094 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.350953 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-certs\") pod \"567d5ac4-76b0-4c66-b415-a5654da2f396\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " Jul 06 18:13:30.351094 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.350984 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-envoy\") pod \"567d5ac4-76b0-4c66-b415-a5654da2f396\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " Jul 06 18:13:30.351094 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.351013 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vs78\" (UniqueName: \"kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-kube-api-access-2vs78\") pod \"567d5ac4-76b0-4c66-b415-a5654da2f396\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " Jul 06 18:13:30.351094 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.351037 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-data\") pod \"567d5ac4-76b0-4c66-b415-a5654da2f396\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " Jul 06 18:13:30.351094 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.351072 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-token\") pod \"567d5ac4-76b0-4c66-b415-a5654da2f396\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " Jul 06 18:13:30.351380 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.351104 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-credential-socket\") pod \"567d5ac4-76b0-4c66-b415-a5654da2f396\" (UID: \"567d5ac4-76b0-4c66-b415-a5654da2f396\") " Jul 06 18:13:30.351380 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.351264 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "567d5ac4-76b0-4c66-b415-a5654da2f396" (UID: "567d5ac4-76b0-4c66-b415-a5654da2f396"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:13:30.351380 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.351278 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "567d5ac4-76b0-4c66-b415-a5654da2f396" (UID: "567d5ac4-76b0-4c66-b415-a5654da2f396"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:13:30.351544 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.351361 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/567d5ac4-76b0-4c66-b415-a5654da2f396-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "567d5ac4-76b0-4c66-b415-a5654da2f396" (UID: "567d5ac4-76b0-4c66-b415-a5654da2f396"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:13:30.351544 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.351462 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "567d5ac4-76b0-4c66-b415-a5654da2f396" (UID: "567d5ac4-76b0-4c66-b415-a5654da2f396"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:13:30.351544 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.351467 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:30.351544 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.351499 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:30.352297 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.352269 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-data" (OuterVolumeSpecName: "istio-data") pod "567d5ac4-76b0-4c66-b415-a5654da2f396" (UID: "567d5ac4-76b0-4c66-b415-a5654da2f396"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:13:30.353102 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.353078 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "567d5ac4-76b0-4c66-b415-a5654da2f396" (UID: "567d5ac4-76b0-4c66-b415-a5654da2f396"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:13:30.353238 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.353215 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "567d5ac4-76b0-4c66-b415-a5654da2f396" (UID: "567d5ac4-76b0-4c66-b415-a5654da2f396"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:13:30.353293 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.353251 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-token" (OuterVolumeSpecName: "istio-token") pod "567d5ac4-76b0-4c66-b415-a5654da2f396" (UID: "567d5ac4-76b0-4c66-b415-a5654da2f396"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:13:30.353471 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.353456 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-kube-api-access-2vs78" (OuterVolumeSpecName: "kube-api-access-2vs78") pod "567d5ac4-76b0-4c66-b415-a5654da2f396" (UID: "567d5ac4-76b0-4c66-b415-a5654da2f396"). InnerVolumeSpecName "kube-api-access-2vs78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:13:30.452292 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.452268 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:30.452292 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.452292 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/567d5ac4-76b0-4c66-b415-a5654da2f396-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:30.452399 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.452300 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:30.452399 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.452308 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vs78\" (UniqueName: \"kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-kube-api-access-2vs78\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:30.452399 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.452316 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:30.452399 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.452324 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/567d5ac4-76b0-4c66-b415-a5654da2f396-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:30.452399 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.452331 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/567d5ac4-76b0-4c66-b415-a5654da2f396-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:13:30.462058 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.462035 2539 generic.go:356] "Generic (PLEG): container finished" podID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerID="842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922" exitCode=0 Jul 06 18:13:30.462139 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.462087 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" Jul 06 18:13:30.462139 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.462124 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" event={"ID":"567d5ac4-76b0-4c66-b415-a5654da2f396","Type":"ContainerDied","Data":"842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922"} Jul 06 18:13:30.462245 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.462177 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt" event={"ID":"567d5ac4-76b0-4c66-b415-a5654da2f396","Type":"ContainerDied","Data":"6a9fd985e0a91f23c02a21aa8ebb6aaea61f38332aef5444623ab8124d2c381c"} Jul 06 18:13:30.462245 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.462205 2539 scope.go:117] "RemoveContainer" containerID="842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922" Jul 06 18:13:30.471414 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.471393 2539 scope.go:117] "RemoveContainer" containerID="90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47" Jul 06 18:13:30.479253 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.479237 2539 scope.go:117] "RemoveContainer" containerID="842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922" Jul 06 18:13:30.479511 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:13:30.479492 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922\": container with ID starting with 842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922 not found: ID does not exist" containerID="842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922" Jul 06 18:13:30.479563 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.479519 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922"} err="failed to get container status \"842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922\": rpc error: code = NotFound desc = could not find container \"842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922\": container with ID starting with 842a80d77afb60f870ba4861a9bfcfed65e3c02ea8c7bf3127c4f217547ed922 not found: ID does not exist" Jul 06 18:13:30.479563 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.479536 2539 scope.go:117] "RemoveContainer" containerID="90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47" Jul 06 18:13:30.479805 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:13:30.479785 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47\": container with ID starting with 90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47 not found: ID does not exist" containerID="90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47" Jul 06 18:13:30.479877 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.479813 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47"} err="failed to get container status \"90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47\": rpc error: code = NotFound desc = could not find container \"90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47\": container with ID starting with 90e93077b8a09a8e28f266cd7bc200942411256143dd66f2c797a91040f30e47 not found: ID does not exist" Jul 06 18:13:30.486066 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.486043 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt"] Jul 06 18:13:30.489928 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:30.489909 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f63d8f-openshift-default-bdc4b7779-blxpt"] Jul 06 18:13:32.303869 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:32.303836 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" path="/var/lib/kubelet/pods/567d5ac4-76b0-4c66-b415-a5654da2f396/volumes" Jul 06 18:13:32.915565 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:32.915522 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:33.261226 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.261195 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:33.532777 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.532684 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh"] Jul 06 18:13:33.533209 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.533103 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" Jul 06 18:13:33.533209 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.533121 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" Jul 06 18:13:33.533209 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.533163 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" Jul 06 18:13:33.533209 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.533172 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" Jul 06 18:13:33.533372 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.533239 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" Jul 06 18:13:33.533372 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.533251 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b244556-a7ac-4f06-93ba-e3022f9813d6" containerName="istio-proxy" Jul 06 18:13:33.533372 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.533257 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" Jul 06 18:13:33.536412 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.536394 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.538971 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.538950 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a0e97d-openshift-default-dockercfg-wxwq4\"" Jul 06 18:13:33.546829 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.546797 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh"] Jul 06 18:13:33.559281 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.559246 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:33.681136 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.681105 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-token\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.681292 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.681152 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4930c863-3965-4c6e-aa40-d17ab20d6139-istiod-ca-cert\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.681292 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.681175 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-podinfo\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.681292 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.681235 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvnb2\" (UniqueName: \"kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-kube-api-access-kvnb2\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.681408 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.681316 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-envoy\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.681408 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.681345 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-certs\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.681408 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.681376 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-data\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.681497 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.681433 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-socket\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.681497 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.681451 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-credential-socket\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.782871 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.782793 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-socket\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.782871 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.782830 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-credential-socket\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783080 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.782875 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-token\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783080 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.782912 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4930c863-3965-4c6e-aa40-d17ab20d6139-istiod-ca-cert\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783080 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.782940 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-podinfo\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783080 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.782964 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvnb2\" (UniqueName: \"kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-kube-api-access-kvnb2\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783080 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.783027 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-envoy\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783080 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.783064 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-certs\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783399 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.783100 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-data\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783399 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.783288 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-socket\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783399 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.783373 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-credential-socket\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783543 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.783440 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-data\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783585 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.783553 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-certs\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.783661 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.783642 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4930c863-3965-4c6e-aa40-d17ab20d6139-istiod-ca-cert\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.785381 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.785357 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-envoy\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.785490 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.785471 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-podinfo\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.790804 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.790782 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-token\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.790804 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.790789 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvnb2\" (UniqueName: \"kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-kube-api-access-kvnb2\") pod \"e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.846820 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.846798 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:33.931972 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.931936 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:33.992126 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.992101 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh"] Jul 06 18:13:33.993820 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:13:33.993793 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4930c863_3965_4c6e_aa40_d17ab20d6139.slice/crio-c4d32bfa5aec2c914f6970766124f4a5d8694b79ad88b92013e4b39689c14892 WatchSource:0}: Error finding container c4d32bfa5aec2c914f6970766124f4a5d8694b79ad88b92013e4b39689c14892: Status 404 returned error can't find the container with id c4d32bfa5aec2c914f6970766124f4a5d8694b79ad88b92013e4b39689c14892 Jul 06 18:13:33.996040 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.996010 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:33.996092 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.996072 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:33.996132 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:33.996101 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:34.485861 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:34.485826 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" event={"ID":"4930c863-3965-4c6e-aa40-d17ab20d6139","Type":"ContainerStarted","Data":"48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1"} Jul 06 18:13:34.486070 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:34.485877 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" event={"ID":"4930c863-3965-4c6e-aa40-d17ab20d6139","Type":"ContainerStarted","Data":"c4d32bfa5aec2c914f6970766124f4a5d8694b79ad88b92013e4b39689c14892"} Jul 06 18:13:34.509602 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:34.509557 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" podStartSLOduration=1.509543565 podStartE2EDuration="1.509543565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:13:34.507651277 +0000 UTC m=+2084.738896452" watchObservedRunningTime="2026-07-06 18:13:34.509543565 +0000 UTC m=+2084.740788738" Jul 06 18:13:34.847634 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:34.847551 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:35.852057 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:35.852028 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:36.489874 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:36.489844 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:36.496391 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:36.496363 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:36.497216 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:36.497195 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:36.589555 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:36.589525 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:36.757892 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:36.757807 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:37.112775 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:37.112655 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:37.220122 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:37.220087 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:37.317761 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:37.317723 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:40.976993 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:40.976955 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:43.977995 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:43.976664 2539 patch_prober.go:28] interesting pod/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:49948->10.134.0.49:15021: read: connection reset by peer" start-of-body= Jul 06 18:13:43.977995 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:43.976753 2539 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:49948->10.134.0.49:15021: read: connection reset by peer" Jul 06 18:13:44.549170 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:44.549141 2539 generic.go:356] "Generic (PLEG): container finished" podID="10263309-514b-4866-85bb-77ffae7c6bc2" containerID="aacad01b9dd69fe856c917be43fce768f5cf53ed5c20fa297b53a39b65866936" exitCode=0 Jul 06 18:13:44.549343 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:44.549181 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" event={"ID":"10263309-514b-4866-85bb-77ffae7c6bc2","Type":"ContainerDied","Data":"aacad01b9dd69fe856c917be43fce768f5cf53ed5c20fa297b53a39b65866936"} Jul 06 18:13:44.549532 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:44.549520 2539 scope.go:117] "RemoveContainer" containerID="aacad01b9dd69fe856c917be43fce768f5cf53ed5c20fa297b53a39b65866936" Jul 06 18:13:44.550491 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:44.550466 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:44.550556 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:44.550533 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:44.550589 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:44.550582 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:45.556434 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:45.556397 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" event={"ID":"10263309-514b-4866-85bb-77ffae7c6bc2","Type":"ContainerStarted","Data":"a4937885382617fc3153a239907db55479f2a0d625ec85bbacf05ba042abe48b"} Jul 06 18:13:46.195613 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:46.195570 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:46.195875 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:46.195845 2539 patch_prober.go:28] interesting pod/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 06 18:13:46.195964 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:46.195918 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 06 18:13:47.196132 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:47.196094 2539 patch_prober.go:28] interesting pod/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 06 18:13:47.196568 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:47.196229 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 06 18:13:48.196624 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:48.196577 2539 patch_prober.go:28] interesting pod/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 06 18:13:48.197151 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:48.196653 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 06 18:13:48.921300 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:48.921206 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:49.208179 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:49.208136 2539 patch_prober.go:28] interesting pod/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 06 18:13:49.208667 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:49.208217 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 06 18:13:49.768354 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:49.768325 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:49.870135 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:49.870099 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:50.198897 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.198870 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:50.199273 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.199252 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:50.199925 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.199902 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:13:50.335671 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.335651 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 18:13:50.340422 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.340406 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 18:13:50.586954 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.586885 2539 generic.go:356] "Generic (PLEG): container finished" podID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerID="48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1" exitCode=0 Jul 06 18:13:50.587053 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.586962 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" event={"ID":"4930c863-3965-4c6e-aa40-d17ab20d6139","Type":"ContainerDied","Data":"48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1"} Jul 06 18:13:50.587489 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.587475 2539 scope.go:117] "RemoveContainer" containerID="48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1" Jul 06 18:13:50.588428 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.588404 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:50.588483 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.588470 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:50.588516 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:50.588501 2539 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 18:13:51.496892 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:51.496857 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:51.599521 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:51.599488 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" event={"ID":"4930c863-3965-4c6e-aa40-d17ab20d6139","Type":"ContainerStarted","Data":"17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369"} Jul 06 18:13:51.847621 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:51.847530 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:51.848782 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:51.848752 2539 patch_prober.go:28] interesting pod/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 06 18:13:51.848945 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:51.848830 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" podUID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 06 18:13:52.847667 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:52.847633 2539 patch_prober.go:28] interesting pod/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 06 18:13:52.848066 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:52.847689 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" podUID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 06 18:13:53.847098 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:53.847063 2539 patch_prober.go:28] interesting pod/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 06 18:13:53.847271 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:53.847122 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" podUID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 06 18:13:54.847808 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:54.847767 2539 patch_prober.go:28] interesting pod/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 06 18:13:54.848196 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:54.847833 2539 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" podUID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 06 18:13:55.851286 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:55.851257 2539 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:55.851760 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:55.851614 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:55.852294 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:55.852274 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:13:57.943984 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:57.943930 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:13:58.034849 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:13:58.034818 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:14:09.811503 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:14:09.811455 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:00.132864 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.132777 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf"] Jul 06 18:15:00.133288 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.133189 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" Jul 06 18:15:00.133288 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.133203 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="567d5ac4-76b0-4c66-b415-a5654da2f396" containerName="istio-proxy" Jul 06 18:15:00.135456 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.135439 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722695-67cxl"] Jul 06 18:15:00.135573 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.135553 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf" Jul 06 18:15:00.137707 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.137677 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" Jul 06 18:15:00.138230 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.138211 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-z2cpm\"" Jul 06 18:15:00.144348 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.144290 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf"] Jul 06 18:15:00.150017 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.149995 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722695-67cxl"] Jul 06 18:15:00.213388 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.213352 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4mxh\" (UniqueName: \"kubernetes.io/projected/e8e7f754-6012-49bf-8275-27ab798cb432-kube-api-access-v4mxh\") pod \"maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf\" (UID: \"e8e7f754-6012-49bf-8275-27ab798cb432\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf" Jul 06 18:15:00.213580 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.213423 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7swvw\" (UniqueName: \"kubernetes.io/projected/594d018e-79a5-439f-9bfa-a979c0050cfe-kube-api-access-7swvw\") pod \"maas-api-key-cleanup-29722695-67cxl\" (UID: \"594d018e-79a5-439f-9bfa-a979c0050cfe\") " pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" Jul 06 18:15:00.313953 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.313925 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7swvw\" (UniqueName: \"kubernetes.io/projected/594d018e-79a5-439f-9bfa-a979c0050cfe-kube-api-access-7swvw\") pod \"maas-api-key-cleanup-29722695-67cxl\" (UID: \"594d018e-79a5-439f-9bfa-a979c0050cfe\") " pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" Jul 06 18:15:00.314114 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.313999 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4mxh\" (UniqueName: \"kubernetes.io/projected/e8e7f754-6012-49bf-8275-27ab798cb432-kube-api-access-v4mxh\") pod \"maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf\" (UID: \"e8e7f754-6012-49bf-8275-27ab798cb432\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf" Jul 06 18:15:00.322595 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.322555 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7swvw\" (UniqueName: \"kubernetes.io/projected/594d018e-79a5-439f-9bfa-a979c0050cfe-kube-api-access-7swvw\") pod \"maas-api-key-cleanup-29722695-67cxl\" (UID: \"594d018e-79a5-439f-9bfa-a979c0050cfe\") " pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" Jul 06 18:15:00.322770 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.322621 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4mxh\" (UniqueName: \"kubernetes.io/projected/e8e7f754-6012-49bf-8275-27ab798cb432-kube-api-access-v4mxh\") pod \"maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf\" (UID: \"e8e7f754-6012-49bf-8275-27ab798cb432\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf" Jul 06 18:15:00.448323 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.448294 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf" Jul 06 18:15:00.457336 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.457314 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" Jul 06 18:15:00.611860 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.611828 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722695-67cxl"] Jul 06 18:15:00.615080 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:15:00.615052 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594d018e_79a5_439f_9bfa_a979c0050cfe.slice/crio-62ef1f56f1a502e67d28775488ddcfc5afd88a28fd111ac6b49ada42efc2a9a2 WatchSource:0}: Error finding container 62ef1f56f1a502e67d28775488ddcfc5afd88a28fd111ac6b49ada42efc2a9a2: Status 404 returned error can't find the container with id 62ef1f56f1a502e67d28775488ddcfc5afd88a28fd111ac6b49ada42efc2a9a2 Jul 06 18:15:00.798863 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.798834 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf"] Jul 06 18:15:00.800064 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:15:00.800040 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e7f754_6012_49bf_8275_27ab798cb432.slice/crio-bad850dd3ccd36da7d61710873acb73c0c55a6a561519b147372bb243db38a8a WatchSource:0}: Error finding container bad850dd3ccd36da7d61710873acb73c0c55a6a561519b147372bb243db38a8a: Status 404 returned error can't find the container with id bad850dd3ccd36da7d61710873acb73c0c55a6a561519b147372bb243db38a8a Jul 06 18:15:00.970412 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.970302 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf" event={"ID":"e8e7f754-6012-49bf-8275-27ab798cb432","Type":"ContainerStarted","Data":"bad850dd3ccd36da7d61710873acb73c0c55a6a561519b147372bb243db38a8a"} Jul 06 18:15:00.972320 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.972295 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" event={"ID":"594d018e-79a5-439f-9bfa-a979c0050cfe","Type":"ContainerStarted","Data":"c38c028186ecd673d8e6de9d12ec3c10cf9f1d2a4452850be0b1ff5710abe2bd"} Jul 06 18:15:00.972443 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.972336 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" event={"ID":"594d018e-79a5-439f-9bfa-a979c0050cfe","Type":"ContainerStarted","Data":"62ef1f56f1a502e67d28775488ddcfc5afd88a28fd111ac6b49ada42efc2a9a2"} Jul 06 18:15:00.990105 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:00.990052 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" podStartSLOduration=0.990037941 podStartE2EDuration="990.037941ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:15:00.987918429 +0000 UTC m=+2171.219163602" watchObservedRunningTime="2026-07-06 18:15:00.990037941 +0000 UTC m=+2171.221283230" Jul 06 18:15:01.978812 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:01.978777 2539 generic.go:356] "Generic (PLEG): container finished" podID="e8e7f754-6012-49bf-8275-27ab798cb432" containerID="796e40f3216ff89ceca2d5671555a761aed89c534359c03d6518a77d8e2639a3" exitCode=0 Jul 06 18:15:01.979274 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:01.978874 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf" event={"ID":"e8e7f754-6012-49bf-8275-27ab798cb432","Type":"ContainerDied","Data":"796e40f3216ff89ceca2d5671555a761aed89c534359c03d6518a77d8e2639a3"} Jul 06 18:15:01.980274 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:01.980251 2539 generic.go:356] "Generic (PLEG): container finished" podID="594d018e-79a5-439f-9bfa-a979c0050cfe" containerID="c38c028186ecd673d8e6de9d12ec3c10cf9f1d2a4452850be0b1ff5710abe2bd" exitCode=0 Jul 06 18:15:01.980371 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:01.980300 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" event={"ID":"594d018e-79a5-439f-9bfa-a979c0050cfe","Type":"ContainerDied","Data":"c38c028186ecd673d8e6de9d12ec3c10cf9f1d2a4452850be0b1ff5710abe2bd"} Jul 06 18:15:03.116600 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.116574 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" Jul 06 18:15:03.132753 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.132726 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf" Jul 06 18:15:03.241574 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.241479 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4mxh\" (UniqueName: \"kubernetes.io/projected/e8e7f754-6012-49bf-8275-27ab798cb432-kube-api-access-v4mxh\") pod \"e8e7f754-6012-49bf-8275-27ab798cb432\" (UID: \"e8e7f754-6012-49bf-8275-27ab798cb432\") " Jul 06 18:15:03.241574 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.241569 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7swvw\" (UniqueName: \"kubernetes.io/projected/594d018e-79a5-439f-9bfa-a979c0050cfe-kube-api-access-7swvw\") pod \"594d018e-79a5-439f-9bfa-a979c0050cfe\" (UID: \"594d018e-79a5-439f-9bfa-a979c0050cfe\") " Jul 06 18:15:03.243714 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.243666 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594d018e-79a5-439f-9bfa-a979c0050cfe-kube-api-access-7swvw" (OuterVolumeSpecName: "kube-api-access-7swvw") pod "594d018e-79a5-439f-9bfa-a979c0050cfe" (UID: "594d018e-79a5-439f-9bfa-a979c0050cfe"). InnerVolumeSpecName "kube-api-access-7swvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:15:03.243714 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.243673 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e7f754-6012-49bf-8275-27ab798cb432-kube-api-access-v4mxh" (OuterVolumeSpecName: "kube-api-access-v4mxh") pod "e8e7f754-6012-49bf-8275-27ab798cb432" (UID: "e8e7f754-6012-49bf-8275-27ab798cb432"). InnerVolumeSpecName "kube-api-access-v4mxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:15:03.343025 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.342986 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7swvw\" (UniqueName: \"kubernetes.io/projected/594d018e-79a5-439f-9bfa-a979c0050cfe-kube-api-access-7swvw\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:15:03.343025 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.343017 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4mxh\" (UniqueName: \"kubernetes.io/projected/e8e7f754-6012-49bf-8275-27ab798cb432-kube-api-access-v4mxh\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:15:03.992207 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.992179 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" Jul 06 18:15:03.992371 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.992179 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722695-67cxl" event={"ID":"594d018e-79a5-439f-9bfa-a979c0050cfe","Type":"ContainerDied","Data":"62ef1f56f1a502e67d28775488ddcfc5afd88a28fd111ac6b49ada42efc2a9a2"} Jul 06 18:15:03.992371 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.992304 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62ef1f56f1a502e67d28775488ddcfc5afd88a28fd111ac6b49ada42efc2a9a2" Jul 06 18:15:03.993618 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.993589 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf" Jul 06 18:15:03.993618 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.993592 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf" event={"ID":"e8e7f754-6012-49bf-8275-27ab798cb432","Type":"ContainerDied","Data":"bad850dd3ccd36da7d61710873acb73c0c55a6a561519b147372bb243db38a8a"} Jul 06 18:15:03.993802 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:03.993631 2539 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bad850dd3ccd36da7d61710873acb73c0c55a6a561519b147372bb243db38a8a" Jul 06 18:15:13.016589 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:13.016551 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:20.634376 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:20.634337 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:56.793654 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:56.793620 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:15:57.692169 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:15:57.692129 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:02.288802 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:16:02.288764 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:10.510857 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:16:10.510824 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:30.012941 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:16:30.012902 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:16:42.457654 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:16:42.457618 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:25.336562 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:17:25.336515 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:26.134282 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:17:26.134249 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:17:32.628318 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:17:32.628272 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:12.718347 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:18:12.718240 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:21.774250 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:18:21.774202 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:21.875258 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:18:21.875228 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:50.370418 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:18:50.370317 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 18:18:50.376937 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:18:50.376913 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 18:18:50.465665 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:18:50.465635 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:50.562362 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:18:50.562326 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:58.627058 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:18:58.627016 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:18:58.729528 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:18:58.729495 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:00.483726 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:00.483675 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:01.435664 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:01.435632 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:02.489230 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:02.489192 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:02.903139 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:02.903050 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:03.043461 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:03.043432 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:03.143895 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:03.143865 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:03.271754 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:03.271719 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf"] Jul 06 18:19:03.274198 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:03.274167 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:03.274349 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:03.274308 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-3b0a18-29722695-75hbf"] Jul 06 18:19:04.303573 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:04.303539 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e7f754-6012-49bf-8275-27ab798cb432" path="/var/lib/kubelet/pods/e8e7f754-6012-49bf-8275-27ab798cb432/volumes" Jul 06 18:19:07.966263 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:07.966228 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:44.816115 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:44.816084 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:45.061655 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:45.061617 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs"] Jul 06 18:19:45.061943 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:45.061891 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" containerID="cri-o://a4937885382617fc3153a239907db55479f2a0d625ec85bbacf05ba042abe48b" gracePeriod=30 Jul 06 18:19:45.084672 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:45.084610 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:45.440542 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:45.440506 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:45.548410 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:45.548379 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:45.952210 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:45.952178 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:46.056845 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:46.056812 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:46.193316 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:46.193284 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:50.200492 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.200463 2539 patch_prober.go:28] interesting pod/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 06 18:19:50.200825 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.200526 2539 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 06 18:19:50.316814 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.316792 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:19:50.436659 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.436631 2539 scope.go:117] "RemoveContainer" containerID="aacad01b9dd69fe856c917be43fce768f5cf53ed5c20fa297b53a39b65866936" Jul 06 18:19:50.445921 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.445903 2539 scope.go:117] "RemoveContainer" containerID="a4937885382617fc3153a239907db55479f2a0d625ec85bbacf05ba042abe48b" Jul 06 18:19:50.450077 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450056 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-envoy\") pod \"10263309-514b-4866-85bb-77ffae7c6bc2\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " Jul 06 18:19:50.450173 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450105 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10263309-514b-4866-85bb-77ffae7c6bc2-istio-podinfo\") pod \"10263309-514b-4866-85bb-77ffae7c6bc2\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " Jul 06 18:19:50.450173 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450139 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-credential-socket\") pod \"10263309-514b-4866-85bb-77ffae7c6bc2\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " Jul 06 18:19:50.450173 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450159 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-istio-token\") pod \"10263309-514b-4866-85bb-77ffae7c6bc2\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " Jul 06 18:19:50.450322 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450173 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-socket\") pod \"10263309-514b-4866-85bb-77ffae7c6bc2\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " Jul 06 18:19:50.450322 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450191 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-certs\") pod \"10263309-514b-4866-85bb-77ffae7c6bc2\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " Jul 06 18:19:50.450322 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450238 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7x4z\" (UniqueName: \"kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-kube-api-access-q7x4z\") pod \"10263309-514b-4866-85bb-77ffae7c6bc2\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " Jul 06 18:19:50.450322 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450296 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10263309-514b-4866-85bb-77ffae7c6bc2-istiod-ca-cert\") pod \"10263309-514b-4866-85bb-77ffae7c6bc2\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " Jul 06 18:19:50.450524 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450323 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-data\") pod \"10263309-514b-4866-85bb-77ffae7c6bc2\" (UID: \"10263309-514b-4866-85bb-77ffae7c6bc2\") " Jul 06 18:19:50.450524 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450464 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10263309-514b-4866-85bb-77ffae7c6bc2" (UID: "10263309-514b-4866-85bb-77ffae7c6bc2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:50.450659 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450638 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:50.450751 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450655 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10263309-514b-4866-85bb-77ffae7c6bc2" (UID: "10263309-514b-4866-85bb-77ffae7c6bc2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:50.450751 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450712 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10263309-514b-4866-85bb-77ffae7c6bc2" (UID: "10263309-514b-4866-85bb-77ffae7c6bc2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:50.450854 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.450818 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10263309-514b-4866-85bb-77ffae7c6bc2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10263309-514b-4866-85bb-77ffae7c6bc2" (UID: "10263309-514b-4866-85bb-77ffae7c6bc2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:19:50.451833 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.451807 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-data" (OuterVolumeSpecName: "istio-data") pod "10263309-514b-4866-85bb-77ffae7c6bc2" (UID: "10263309-514b-4866-85bb-77ffae7c6bc2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:50.452482 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.452458 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-kube-api-access-q7x4z" (OuterVolumeSpecName: "kube-api-access-q7x4z") pod "10263309-514b-4866-85bb-77ffae7c6bc2" (UID: "10263309-514b-4866-85bb-77ffae7c6bc2"). InnerVolumeSpecName "kube-api-access-q7x4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:19:50.452687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.452651 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10263309-514b-4866-85bb-77ffae7c6bc2" (UID: "10263309-514b-4866-85bb-77ffae7c6bc2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:50.452780 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.452732 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10263309-514b-4866-85bb-77ffae7c6bc2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10263309-514b-4866-85bb-77ffae7c6bc2" (UID: "10263309-514b-4866-85bb-77ffae7c6bc2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:19:50.452912 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.452891 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-istio-token" (OuterVolumeSpecName: "istio-token") pod "10263309-514b-4866-85bb-77ffae7c6bc2" (UID: "10263309-514b-4866-85bb-77ffae7c6bc2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:19:50.454773 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.454758 2539 scope.go:117] "RemoveContainer" containerID="5f7666a6dafc5ed3466918ab686e0e2f7d807addd078531e74c62a1a7a9b70c3" Jul 06 18:19:50.483276 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.483257 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" Jul 06 18:19:50.483355 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.483254 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" event={"ID":"10263309-514b-4866-85bb-77ffae7c6bc2","Type":"ContainerDied","Data":"a4937885382617fc3153a239907db55479f2a0d625ec85bbacf05ba042abe48b"} Jul 06 18:19:50.483402 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.483385 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs" event={"ID":"10263309-514b-4866-85bb-77ffae7c6bc2","Type":"ContainerDied","Data":"275f18a5beb4d68eb8e024afb92601daeeeb5d576ddd49d2a00cf250d4bf5c8c"} Jul 06 18:19:50.502350 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.502330 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs"] Jul 06 18:19:50.507415 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.507394 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-3b0a18-openshift-default-579c447599-mdcjs"] Jul 06 18:19:50.551033 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.551014 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:50.551109 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.551035 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10263309-514b-4866-85bb-77ffae7c6bc2-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:50.551109 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.551044 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:50.551109 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.551052 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:50.551109 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.551062 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:50.551109 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.551070 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7x4z\" (UniqueName: \"kubernetes.io/projected/10263309-514b-4866-85bb-77ffae7c6bc2-kube-api-access-q7x4z\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:50.551109 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.551079 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10263309-514b-4866-85bb-77ffae7c6bc2-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:50.551109 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:50.551086 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10263309-514b-4866-85bb-77ffae7c6bc2-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:51.740601 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:51.740557 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:51.841206 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:51.841150 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:51.978451 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:51.978418 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh"] Jul 06 18:19:51.978711 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:51.978668 2539 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" podUID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerName="istio-proxy" containerID="cri-o://17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369" gracePeriod=30 Jul 06 18:19:51.991943 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:51.991870 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:52.261676 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:52.261589 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:19:52.304212 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:52.304181 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" path="/var/lib/kubelet/pods/10263309-514b-4866-85bb-77ffae7c6bc2/volumes" Jul 06 18:19:55.854157 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:55.854121 2539 patch_prober.go:28] interesting pod/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 18:19:55.854520 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:55.854191 2539 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" podUID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 18:19:57.231142 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.231115 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:19:57.313212 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313134 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-data\") pod \"4930c863-3965-4c6e-aa40-d17ab20d6139\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " Jul 06 18:19:57.313348 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313216 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-credential-socket\") pod \"4930c863-3965-4c6e-aa40-d17ab20d6139\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " Jul 06 18:19:57.313348 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313261 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvnb2\" (UniqueName: \"kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-kube-api-access-kvnb2\") pod \"4930c863-3965-4c6e-aa40-d17ab20d6139\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " Jul 06 18:19:57.313348 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313295 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-envoy\") pod \"4930c863-3965-4c6e-aa40-d17ab20d6139\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " Jul 06 18:19:57.313348 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313321 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-token\") pod \"4930c863-3965-4c6e-aa40-d17ab20d6139\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " Jul 06 18:19:57.313348 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313342 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-podinfo\") pod \"4930c863-3965-4c6e-aa40-d17ab20d6139\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " Jul 06 18:19:57.313595 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313374 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-socket\") pod \"4930c863-3965-4c6e-aa40-d17ab20d6139\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " Jul 06 18:19:57.313595 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313413 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-certs\") pod \"4930c863-3965-4c6e-aa40-d17ab20d6139\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " Jul 06 18:19:57.313595 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313455 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4930c863-3965-4c6e-aa40-d17ab20d6139" (UID: "4930c863-3965-4c6e-aa40-d17ab20d6139"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:57.313595 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313515 2539 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4930c863-3965-4c6e-aa40-d17ab20d6139-istiod-ca-cert\") pod \"4930c863-3965-4c6e-aa40-d17ab20d6139\" (UID: \"4930c863-3965-4c6e-aa40-d17ab20d6139\") " Jul 06 18:19:57.313882 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313726 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4930c863-3965-4c6e-aa40-d17ab20d6139" (UID: "4930c863-3965-4c6e-aa40-d17ab20d6139"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:57.313882 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313858 2539 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-credential-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:57.313996 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313886 2539 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-certs\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:57.313996 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.313857 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4930c863-3965-4c6e-aa40-d17ab20d6139" (UID: "4930c863-3965-4c6e-aa40-d17ab20d6139"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:57.314095 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.314042 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4930c863-3965-4c6e-aa40-d17ab20d6139-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4930c863-3965-4c6e-aa40-d17ab20d6139" (UID: "4930c863-3965-4c6e-aa40-d17ab20d6139"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 18:19:57.314278 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.314255 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-data" (OuterVolumeSpecName: "istio-data") pod "4930c863-3965-4c6e-aa40-d17ab20d6139" (UID: "4930c863-3965-4c6e-aa40-d17ab20d6139"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:57.315633 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.315605 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-kube-api-access-kvnb2" (OuterVolumeSpecName: "kube-api-access-kvnb2") pod "4930c863-3965-4c6e-aa40-d17ab20d6139" (UID: "4930c863-3965-4c6e-aa40-d17ab20d6139"). InnerVolumeSpecName "kube-api-access-kvnb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:19:57.315633 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.315624 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4930c863-3965-4c6e-aa40-d17ab20d6139" (UID: "4930c863-3965-4c6e-aa40-d17ab20d6139"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 18:19:57.316043 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.316025 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-token" (OuterVolumeSpecName: "istio-token") pod "4930c863-3965-4c6e-aa40-d17ab20d6139" (UID: "4930c863-3965-4c6e-aa40-d17ab20d6139"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 18:19:57.316117 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.316038 2539 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4930c863-3965-4c6e-aa40-d17ab20d6139" (UID: "4930c863-3965-4c6e-aa40-d17ab20d6139"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 18:19:57.414616 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.414586 2539 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4930c863-3965-4c6e-aa40-d17ab20d6139-istiod-ca-cert\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:57.414616 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.414617 2539 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-data\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:57.414616 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.414625 2539 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvnb2\" (UniqueName: \"kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-kube-api-access-kvnb2\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:57.414844 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.414634 2539 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-envoy\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:57.414844 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.414642 2539 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-token\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:57.414844 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.414649 2539 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4930c863-3965-4c6e-aa40-d17ab20d6139-istio-podinfo\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:57.414844 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.414656 2539 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4930c863-3965-4c6e-aa40-d17ab20d6139-workload-socket\") on node \"ip-10-0-137-203.ec2.internal\" DevicePath \"\"" Jul 06 18:19:57.517274 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.517247 2539 generic.go:356] "Generic (PLEG): container finished" podID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerID="17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369" exitCode=0 Jul 06 18:19:57.517389 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.517298 2539 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" Jul 06 18:19:57.517389 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.517331 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" event={"ID":"4930c863-3965-4c6e-aa40-d17ab20d6139","Type":"ContainerDied","Data":"17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369"} Jul 06 18:19:57.517389 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.517385 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh" event={"ID":"4930c863-3965-4c6e-aa40-d17ab20d6139","Type":"ContainerDied","Data":"c4d32bfa5aec2c914f6970766124f4a5d8694b79ad88b92013e4b39689c14892"} Jul 06 18:19:57.517495 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.517406 2539 scope.go:117] "RemoveContainer" containerID="17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369" Jul 06 18:19:57.532956 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.532938 2539 scope.go:117] "RemoveContainer" containerID="48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1" Jul 06 18:19:57.541076 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.541059 2539 scope.go:117] "RemoveContainer" containerID="17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369" Jul 06 18:19:57.541301 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:19:57.541286 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369\": container with ID starting with 17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369 not found: ID does not exist" containerID="17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369" Jul 06 18:19:57.541345 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.541307 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369"} err="failed to get container status \"17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369\": rpc error: code = NotFound desc = could not find container \"17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369\": container with ID starting with 17800aa424a968bb11a56ea705c1cb84f401de218256b693c2f60a14f6e2a369 not found: ID does not exist" Jul 06 18:19:57.541345 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.541321 2539 scope.go:117] "RemoveContainer" containerID="48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1" Jul 06 18:19:57.541541 ip-10-0-137-203 kubenswrapper[2539]: E0706 18:19:57.541520 2539 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1\": container with ID starting with 48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1 not found: ID does not exist" containerID="48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1" Jul 06 18:19:57.541590 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.541548 2539 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1"} err="failed to get container status \"48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1\": rpc error: code = NotFound desc = could not find container \"48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1\": container with ID starting with 48b002117772a35ae964b82fe9a88a28c59475d1829778c5c67aab3160ee8ab1 not found: ID does not exist" Jul 06 18:19:57.545965 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.545945 2539 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh"] Jul 06 18:19:57.551845 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.551826 2539 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a0e97d-openshift-default-5b86954495-w66nh"] Jul 06 18:19:57.656543 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.656486 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722680-5b7sc_da27fe33-3204-4ff2-b884-34c4903f6919/cleanup/0.log" Jul 06 18:19:57.772483 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:57.772458 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722695-67cxl_594d018e-79a5-439f-9bfa-a979c0050cfe/cleanup/0.log" Jul 06 18:19:58.303362 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:58.303322 2539 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4930c863-3965-4c6e-aa40-d17ab20d6139" path="/var/lib/kubelet/pods/4930c863-3965-4c6e-aa40-d17ab20d6139/volumes" Jul 06 18:19:58.510380 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:58.510352 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597bcb8998-k4dkk_e9b60eb0-8d37-4048-bd74-7ff20a22ad97/copy-manifests/0.log" Jul 06 18:19:58.518294 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:58.518261 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597bcb8998-k4dkk_e9b60eb0-8d37-4048-bd74-7ff20a22ad97/manager/0.log" Jul 06 18:19:59.408720 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.408672 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp_5030c8b4-0341-4d31-8eb3-55a1228279ff/util/0.log" Jul 06 18:19:59.416172 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.416151 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp_5030c8b4-0341-4d31-8eb3-55a1228279ff/pull/0.log" Jul 06 18:19:59.423221 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.423194 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp_5030c8b4-0341-4d31-8eb3-55a1228279ff/extract/0.log" Jul 06 18:19:59.536427 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.536410 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5_be654630-64d4-4746-9ca4-ee30c9103e13/util/0.log" Jul 06 18:19:59.544169 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.544150 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5_be654630-64d4-4746-9ca4-ee30c9103e13/pull/0.log" Jul 06 18:19:59.551578 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.551562 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5_be654630-64d4-4746-9ca4-ee30c9103e13/extract/0.log" Jul 06 18:19:59.662608 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.662557 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn_e8536547-3f4c-437d-bf1c-cc21958d85ed/util/0.log" Jul 06 18:19:59.669925 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.669906 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn_e8536547-3f4c-437d-bf1c-cc21958d85ed/pull/0.log" Jul 06 18:19:59.677277 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.677253 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn_e8536547-3f4c-437d-bf1c-cc21958d85ed/extract/0.log" Jul 06 18:19:59.789999 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.789979 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4_865186d7-6287-487b-9892-998cd51e649e/util/0.log" Jul 06 18:19:59.797830 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.797811 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4_865186d7-6287-487b-9892-998cd51e649e/pull/0.log" Jul 06 18:19:59.805009 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:19:59.804977 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4_865186d7-6287-487b-9892-998cd51e649e/extract/0.log" Jul 06 18:20:01.164732 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:01.164690 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l6l8c_6142c87d-c309-4690-9e5e-7a18c883e7b0/istio-proxy/0.log" Jul 06 18:20:01.291080 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:01.291050 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2vtbs_6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e/discovery/0.log" Jul 06 18:20:01.646208 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:01.646171 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wzgdg_7abc9186-7495-4fe2-a67b-60044ed70c69/istio-proxy/1.log" Jul 06 18:20:02.012096 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:02.012054 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-599fdbdbf7-2z768_8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1/router/0.log" Jul 06 18:20:02.461545 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:02.461507 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-tsc25_2011d1a9-a5d1-4965-91e3-e855d46ed4a5/main/0.log" Jul 06 18:20:02.816347 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:02.816271 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-th4jp_cfb4dafc-ce8d-4977-bbe5-7daff8d8415e/main/0.log" Jul 06 18:20:07.424665 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:07.424608 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:07.522806 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:07.522769 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:10.390917 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:10.390881 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kd4d2_e758f834-160a-40f4-a469-520979a5e4c7/global-pull-secret-syncer/0.log" Jul 06 18:20:10.485045 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:10.484986 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" Jul 06 18:20:10.590545 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:10.590511 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-203.ec2.internal_5b7813548906f23d840a9a9ca553f805/haproxy/0.log" Jul 06 18:20:15.325147 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.325114 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp_5030c8b4-0341-4d31-8eb3-55a1228279ff/extract/0.log" Jul 06 18:20:15.344351 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.344321 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp_5030c8b4-0341-4d31-8eb3-55a1228279ff/util/0.log" Jul 06 18:20:15.363573 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.363550 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nj2kp_5030c8b4-0341-4d31-8eb3-55a1228279ff/pull/0.log" Jul 06 18:20:15.387298 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.387279 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5_be654630-64d4-4746-9ca4-ee30c9103e13/extract/0.log" Jul 06 18:20:15.406168 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.406148 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5_be654630-64d4-4746-9ca4-ee30c9103e13/util/0.log" Jul 06 18:20:15.424812 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.424787 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0g7np5_be654630-64d4-4746-9ca4-ee30c9103e13/pull/0.log" Jul 06 18:20:15.451283 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.451265 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn_e8536547-3f4c-437d-bf1c-cc21958d85ed/extract/0.log" Jul 06 18:20:15.470119 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.470100 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn_e8536547-3f4c-437d-bf1c-cc21958d85ed/util/0.log" Jul 06 18:20:15.489766 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.489749 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73stqnn_e8536547-3f4c-437d-bf1c-cc21958d85ed/pull/0.log" Jul 06 18:20:15.515261 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.515240 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4_865186d7-6287-487b-9892-998cd51e649e/extract/0.log" Jul 06 18:20:15.538644 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.538623 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4_865186d7-6287-487b-9892-998cd51e649e/util/0.log" Jul 06 18:20:15.564241 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:15.564217 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zpkj4_865186d7-6287-487b-9892-998cd51e649e/pull/0.log" Jul 06 18:20:16.712412 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:16.712377 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:17.985813 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:17.985789 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_209c366c-bdae-4dce-b999-a244d8328769/alertmanager/0.log" Jul 06 18:20:18.008861 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.008838 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_209c366c-bdae-4dce-b999-a244d8328769/config-reloader/0.log" Jul 06 18:20:18.029721 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.029683 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_209c366c-bdae-4dce-b999-a244d8328769/kube-rbac-proxy-web/0.log" Jul 06 18:20:18.048605 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.048584 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_209c366c-bdae-4dce-b999-a244d8328769/kube-rbac-proxy/0.log" Jul 06 18:20:18.070322 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.070304 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_209c366c-bdae-4dce-b999-a244d8328769/kube-rbac-proxy-metric/0.log" Jul 06 18:20:18.093609 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.093560 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_209c366c-bdae-4dce-b999-a244d8328769/prom-label-proxy/0.log" Jul 06 18:20:18.119454 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.119438 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_209c366c-bdae-4dce-b999-a244d8328769/init-config-reloader/0.log" Jul 06 18:20:18.173248 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.173229 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-t9l7l_067d2964-906f-4f68-8241-775c582678d9/cluster-monitoring-operator/0.log" Jul 06 18:20:18.204805 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.204780 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-fbqj9_080c2129-ddd3-4dd4-88ab-eca13e82466a/kube-state-metrics/0.log" Jul 06 18:20:18.223571 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.223553 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-fbqj9_080c2129-ddd3-4dd4-88ab-eca13e82466a/kube-rbac-proxy-main/0.log" Jul 06 18:20:18.244351 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.244329 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-fbqj9_080c2129-ddd3-4dd4-88ab-eca13e82466a/kube-rbac-proxy-self/0.log" Jul 06 18:20:18.301328 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.301302 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-5pxd6_33fab8e8-99d4-48e5-a524-ffc419c108aa/monitoring-plugin/0.log" Jul 06 18:20:18.572974 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.572947 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tdd7z_f16f4765-835f-4182-929a-7f979fc67cca/node-exporter/0.log" Jul 06 18:20:18.592842 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.592822 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tdd7z_f16f4765-835f-4182-929a-7f979fc67cca/kube-rbac-proxy/0.log" Jul 06 18:20:18.610908 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:18.610890 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tdd7z_f16f4765-835f-4182-929a-7f979fc67cca/init-textfile/0.log" Jul 06 18:20:20.492131 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492094 2539 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz"] Jul 06 18:20:20.492570 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492496 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" Jul 06 18:20:20.492570 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492512 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" Jul 06 18:20:20.492570 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492522 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" Jul 06 18:20:20.492570 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492528 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" Jul 06 18:20:20.492570 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492537 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e7f754-6012-49bf-8275-27ab798cb432" containerName="cleanup" Jul 06 18:20:20.492570 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492543 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e7f754-6012-49bf-8275-27ab798cb432" containerName="cleanup" Jul 06 18:20:20.492570 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492553 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerName="istio-proxy" Jul 06 18:20:20.492570 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492558 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerName="istio-proxy" Jul 06 18:20:20.492570 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492569 2539 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594d018e-79a5-439f-9bfa-a979c0050cfe" containerName="cleanup" Jul 06 18:20:20.492570 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492574 2539 state_mem.go:107] "Deleted CPUSet assignment" podUID="594d018e-79a5-439f-9bfa-a979c0050cfe" containerName="cleanup" Jul 06 18:20:20.492958 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492633 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" Jul 06 18:20:20.492958 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492640 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="4930c863-3965-4c6e-aa40-d17ab20d6139" containerName="istio-proxy" Jul 06 18:20:20.492958 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492647 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="10263309-514b-4866-85bb-77ffae7c6bc2" containerName="istio-proxy" Jul 06 18:20:20.492958 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492652 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="594d018e-79a5-439f-9bfa-a979c0050cfe" containerName="cleanup" Jul 06 18:20:20.492958 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.492657 2539 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e7f754-6012-49bf-8275-27ab798cb432" containerName="cleanup" Jul 06 18:20:20.495450 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.495431 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.498016 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.497996 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9w8k6\"/\"kube-root-ca.crt\"" Jul 06 18:20:20.499310 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.499283 2539 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9w8k6\"/\"default-dockercfg-s5m7h\"" Jul 06 18:20:20.499420 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.499312 2539 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9w8k6\"/\"openshift-service-ca.crt\"" Jul 06 18:20:20.502109 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.502084 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz"] Jul 06 18:20:20.619436 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.619415 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-lib-modules\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.619572 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.619473 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnn6k\" (UniqueName: \"kubernetes.io/projected/cbd6ab6b-bb10-42e0-b078-66e96e710443-kube-api-access-pnn6k\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.619572 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.619518 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-proc\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.619687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.619576 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-podres\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.619687 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.619655 2539 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-sys\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.720562 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.720537 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-lib-modules\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.720667 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.720582 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnn6k\" (UniqueName: \"kubernetes.io/projected/cbd6ab6b-bb10-42e0-b078-66e96e710443-kube-api-access-pnn6k\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.720667 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.720599 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-proc\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.720667 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.720627 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-podres\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.720667 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.720659 2539 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-sys\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.720838 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.720748 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-sys\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.720838 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.720763 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-proc\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.720838 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.720746 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-lib-modules\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.720838 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.720801 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cbd6ab6b-bb10-42e0-b078-66e96e710443-podres\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.729276 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.729255 2539 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnn6k\" (UniqueName: \"kubernetes.io/projected/cbd6ab6b-bb10-42e0-b078-66e96e710443-kube-api-access-pnn6k\") pod \"perf-node-gather-daemonset-5hqzz\" (UID: \"cbd6ab6b-bb10-42e0-b078-66e96e710443\") " pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.806293 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.806241 2539 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:20.936930 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:20.936897 2539 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz"] Jul 06 18:20:20.938357 ip-10-0-137-203 kubenswrapper[2539]: W0706 18:20:20.938327 2539 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcbd6ab6b_bb10_42e0_b078_66e96e710443.slice/crio-284a12c7e5d3e93f6b1743233d241bfbbd66f24453eec91c3d2b7f7bdb8189f3 WatchSource:0}: Error finding container 284a12c7e5d3e93f6b1743233d241bfbbd66f24453eec91c3d2b7f7bdb8189f3: Status 404 returned error can't find the container with id 284a12c7e5d3e93f6b1743233d241bfbbd66f24453eec91c3d2b7f7bdb8189f3 Jul 06 18:20:21.365260 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:21.365234 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69fb475f8f-rctjl_a12ea03f-404f-4342-84c4-d99070692f9b/console/0.log" Jul 06 18:20:21.640732 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:21.640634 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" event={"ID":"cbd6ab6b-bb10-42e0-b078-66e96e710443","Type":"ContainerStarted","Data":"c77412d241963724c675c9ca88c2ccf705605d46c97ec7ea404f6683aac1611c"} Jul 06 18:20:21.640732 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:21.640680 2539 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" event={"ID":"cbd6ab6b-bb10-42e0-b078-66e96e710443","Type":"ContainerStarted","Data":"284a12c7e5d3e93f6b1743233d241bfbbd66f24453eec91c3d2b7f7bdb8189f3"} Jul 06 18:20:21.641161 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:21.640737 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:21.657052 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:21.657004 2539 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" podStartSLOduration=1.656990409 podStartE2EDuration="1.656990409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 18:20:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 18:20:21.655423303 +0000 UTC m=+2491.886668480" watchObservedRunningTime="2026-07-06 18:20:21.656990409 +0000 UTC m=+2491.888235583" Jul 06 18:20:22.940291 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:22.940260 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgt8l_c0531ce9-1b32-4c03-b7b0-f84f6da395dd/dns/0.log" Jul 06 18:20:22.959483 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:22.959457 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgt8l_c0531ce9-1b32-4c03-b7b0-f84f6da395dd/kube-rbac-proxy/0.log" Jul 06 18:20:23.002641 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:23.002620 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pjllx_eba56436-f6d7-4268-a036-476e9da0943e/dns-node-resolver/0.log" Jul 06 18:20:23.504287 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:23.504259 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78df6d6598-snpwv_718ef886-2d81-4d59-9145-a097a0c60b88/registry/0.log" Jul 06 18:20:23.544299 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:23.544273 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gx4hg_1a4e159e-96e1-4c0c-a18c-223035520e0e/node-ca/0.log" Jul 06 18:20:24.444402 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:24.444373 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l6l8c_6142c87d-c309-4690-9e5e-7a18c883e7b0/istio-proxy/0.log" Jul 06 18:20:24.627201 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:24.627168 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2vtbs_6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e/discovery/0.log" Jul 06 18:20:24.690798 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:24.690771 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wzgdg_7abc9186-7495-4fe2-a67b-60044ed70c69/istio-proxy/0.log" Jul 06 18:20:24.747444 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:24.747379 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wzgdg_7abc9186-7495-4fe2-a67b-60044ed70c69/istio-proxy/1.log" Jul 06 18:20:24.876315 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:24.876277 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-599fdbdbf7-2z768_8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1/router/0.log" Jul 06 18:20:25.598818 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:25.598789 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p6k57_3bbfc510-7647-447b-b42b-4b309310f1ee/serve-healthcheck-canary/0.log" Jul 06 18:20:26.114205 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:26.114171 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8nnx_c530330e-41f4-4f28-8886-40595f987595/kube-rbac-proxy/0.log" Jul 06 18:20:26.134592 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:26.134557 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8nnx_c530330e-41f4-4f28-8886-40595f987595/exporter/0.log" Jul 06 18:20:26.153721 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:26.153673 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t8nnx_c530330e-41f4-4f28-8886-40595f987595/extractor/0.log" Jul 06 18:20:27.655288 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:27.655261 2539 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9w8k6/perf-node-gather-daemonset-5hqzz" Jul 06 18:20:28.548624 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:28.548595 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722680-5b7sc_da27fe33-3204-4ff2-b884-34c4903f6919/cleanup/0.log" Jul 06 18:20:28.572498 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:28.572473 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722695-67cxl_594d018e-79a5-439f-9bfa-a979c0050cfe/cleanup/0.log" Jul 06 18:20:28.937862 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:28.937835 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597bcb8998-k4dkk_e9b60eb0-8d37-4048-bd74-7ff20a22ad97/manager/0.log" Jul 06 18:20:28.955396 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:28.955374 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-597bcb8998-k4dkk_e9b60eb0-8d37-4048-bd74-7ff20a22ad97/copy-manifests/0.log" Jul 06 18:20:30.550737 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:30.550672 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68c469dbcb-sb7hh_fd3c027d-0696-4273-93a7-20c248dcc1ff/manager/0.log" Jul 06 18:20:31.273055 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:31.273026 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l6l8c_6142c87d-c309-4690-9e5e-7a18c883e7b0/istio-proxy/0.log" Jul 06 18:20:31.453921 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:31.453892 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2vtbs_6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e/discovery/0.log" Jul 06 18:20:31.498306 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:31.498278 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wzgdg_7abc9186-7495-4fe2-a67b-60044ed70c69/istio-proxy/0.log" Jul 06 18:20:31.553670 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:31.553569 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wzgdg_7abc9186-7495-4fe2-a67b-60044ed70c69/istio-proxy/1.log" Jul 06 18:20:31.667927 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:31.667891 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-599fdbdbf7-2z768_8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1/router/0.log" Jul 06 18:20:32.900270 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:32.900236 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4l6l8c_6142c87d-c309-4690-9e5e-7a18c883e7b0/istio-proxy/0.log" Jul 06 18:20:33.079732 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:33.079689 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2vtbs_6fe40c6d-da74-479b-bb8e-1ddcc4d0e60e/discovery/0.log" Jul 06 18:20:33.126490 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:33.126459 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wzgdg_7abc9186-7495-4fe2-a67b-60044ed70c69/istio-proxy/0.log" Jul 06 18:20:33.182108 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:33.182074 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-wzgdg_7abc9186-7495-4fe2-a67b-60044ed70c69/istio-proxy/1.log" Jul 06 18:20:33.284587 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:33.284561 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-599fdbdbf7-2z768_8cc99cc9-00b5-42ba-ac0a-1edb0b5122d1/router/0.log" Jul 06 18:20:35.345061 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:35.345014 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-gs5p8_90b18a10-eb9b-4b74-8698-9aff666d52d8/migrator/0.log" Jul 06 18:20:35.363547 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:35.363525 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-gs5p8_90b18a10-eb9b-4b74-8698-9aff666d52d8/graceful-termination/0.log" Jul 06 18:20:36.116256 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:36.116225 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:36.211467 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:36.211437 2539 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drkkl_70aaad28-a30e-4bb0-8919-df1cbb7c0ea9/konnectivity-agent/0.log" limit=1024 Jul 06 18:20:36.854555 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:36.854529 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xq8hn_787a3934-5d38-4057-99a1-3332f7da451d/kube-multus-additional-cni-plugins/0.log" Jul 06 18:20:36.876007 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:36.875976 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xq8hn_787a3934-5d38-4057-99a1-3332f7da451d/egress-router-binary-copy/0.log" Jul 06 18:20:36.894577 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:36.894556 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xq8hn_787a3934-5d38-4057-99a1-3332f7da451d/cni-plugins/0.log" Jul 06 18:20:36.913556 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:36.913538 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xq8hn_787a3934-5d38-4057-99a1-3332f7da451d/bond-cni-plugin/0.log" Jul 06 18:20:36.937117 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:36.937095 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xq8hn_787a3934-5d38-4057-99a1-3332f7da451d/routeoverride-cni/0.log" Jul 06 18:20:36.956320 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:36.956305 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xq8hn_787a3934-5d38-4057-99a1-3332f7da451d/whereabouts-cni-bincopy/0.log" Jul 06 18:20:36.979343 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:36.979321 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xq8hn_787a3934-5d38-4057-99a1-3332f7da451d/whereabouts-cni/0.log" Jul 06 18:20:37.057327 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:37.057301 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jqmtq_dda9101d-ad36-4d77-8169-2d8b7524075b/kube-multus/0.log" Jul 06 18:20:37.142424 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:37.142343 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dpd7c_a31b714e-0b4b-4193-baf1-4473afd54463/network-metrics-daemon/0.log" Jul 06 18:20:37.158792 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:37.158772 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dpd7c_a31b714e-0b4b-4193-baf1-4473afd54463/kube-rbac-proxy/0.log" Jul 06 18:20:38.055210 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:38.055182 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-controller/0.log" Jul 06 18:20:38.070531 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:38.070503 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/0.log" Jul 06 18:20:38.070671 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:38.070544 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/ovn-acl-logging/1.log" Jul 06 18:20:38.091588 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:38.091565 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/kube-rbac-proxy-node/0.log" Jul 06 18:20:38.111774 ip-10-0-137-203 kubenswrapper[2539]: I0706 18:20:38.111752 2539 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rcbtm_a46359ec-0a2a-464a-9f12-9997480a91a3/kube-rbac-proxy-ovn-metrics/0.log"