Jun 10 12:45:36.447397 ip-10-0-140-135 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 12:45:36.447408 ip-10-0-140-135 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 12:45:36.447417 ip-10-0-140-135 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 12:45:36.447718 ip-10-0-140-135 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 12:45:46.618478 ip-10-0-140-135 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 12:45:46.618493 ip-10-0-140-135 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ddc5bcb68ff0456598a4fe2210fc9412 -- Jun 10 12:48:05.303194 ip-10-0-140-135 systemd[1]: Starting Kubernetes Kubelet... Jun 10 12:48:05.772198 ip-10-0-140-135 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:48:05.772198 ip-10-0-140-135 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 12:48:05.772198 ip-10-0-140-135 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:48:05.772198 ip-10-0-140-135 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 12:48:05.772198 ip-10-0-140-135 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:48:05.774166 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.774081 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 12:48:05.779283 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779268 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:48:05.779283 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779283 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779287 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779291 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779294 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779305 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779308 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779312 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779314 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779317 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779320 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779322 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779325 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779328 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779331 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779334 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779337 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779341 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779345 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779348 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:48:05.779349 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779352 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779355 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779358 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779361 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779364 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779367 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779369 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779372 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779374 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779377 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779380 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779382 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779384 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779387 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779390 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779393 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779395 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779398 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779401 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779403 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:48:05.779807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779406 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779409 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779413 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779416 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779419 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779421 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779424 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779427 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779430 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779432 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779435 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779438 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779441 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779444 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779448 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779452 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779456 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779459 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779463 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:48:05.780342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779466 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779469 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779472 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779475 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779478 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779480 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779483 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779485 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779488 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779491 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779494 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779496 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779500 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779503 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779505 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779508 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779510 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779513 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779516 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779519 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:48:05.780803 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779521 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779524 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779526 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779529 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779531 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779534 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779536 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779540 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779544 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779546 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779549 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779551 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779554 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779556 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779559 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779562 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779564 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779567 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779569 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.779572 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:48:05.781331 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780332 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780339 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780342 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780345 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780348 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780352 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780355 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780358 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780361 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780364 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780366 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780369 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780371 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780374 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780377 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780379 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780381 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780384 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780387 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780390 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:48:05.781823 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780393 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780396 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780399 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780401 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780404 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780407 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780409 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780412 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780414 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780417 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780420 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780422 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780425 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780427 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780430 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780433 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780435 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780437 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780440 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780443 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:48:05.782379 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780446 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780448 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780451 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780453 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780456 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780460 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780464 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780466 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780469 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780472 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780475 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780479 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780499 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780504 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780508 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780511 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780514 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780516 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780519 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780521 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:48:05.782864 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780524 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780527 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780529 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780532 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780534 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780537 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780540 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780543 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780546 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780548 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780551 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780554 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780557 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780559 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780562 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780564 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780567 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780569 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780571 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:48:05.783364 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780574 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780577 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780580 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780582 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780585 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780588 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780592 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780596 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780600 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780604 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780606 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780609 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780612 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780614 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780617 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780620 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780622 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780625 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780628 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:48:05.783824 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.780630 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781070 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781076 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781080 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781084 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781088 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781091 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781094 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781097 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781099 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781102 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781105 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781107 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781110 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781113 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781116 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781120 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781125 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781128 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:48:05.784328 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781130 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781133 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781136 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781138 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781141 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781144 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781146 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781149 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781152 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781155 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781158 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781162 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781166 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781170 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781173 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781176 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781178 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781181 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781183 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781187 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:48:05.784795 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781192 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781196 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781199 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781202 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781204 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781207 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781210 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781213 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781216 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781218 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781221 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781223 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781226 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781228 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781231 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781235 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781238 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781241 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781244 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781247 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:48:05.785304 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781250 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781253 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781255 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781258 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781263 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781266 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781268 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781271 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781273 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781276 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781279 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781281 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781285 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781288 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781290 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781293 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781295 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781298 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781300 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:48:05.785782 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781303 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781308 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781310 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781313 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781315 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781318 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781321 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781323 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781326 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781328 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781331 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781334 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781336 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781339 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781342 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781345 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781347 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781351 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781354 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781356 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:48:05.786255 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781359 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.781361 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781431 2570 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781439 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781446 2570 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781451 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781455 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781459 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781463 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781467 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781470 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781473 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781477 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781482 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781486 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781489 2570 flags.go:64] FLAG: --cgroup-root="" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781492 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781495 2570 flags.go:64] FLAG: --client-ca-file="" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781497 2570 flags.go:64] FLAG: --cloud-provider="external" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781500 2570 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781505 2570 flags.go:64] FLAG: --cluster-domain="" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781508 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781511 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781514 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 12:48:05.786717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781518 2570 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781522 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781525 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781529 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781532 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781536 2570 flags.go:64] FLAG: --contention-profiling="false" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781539 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781542 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781545 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781548 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781552 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781555 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781558 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781561 2570 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781564 2570 flags.go:64] FLAG: --enable-server="true" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781568 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781573 2570 flags.go:64] FLAG: --event-burst="100" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781577 2570 flags.go:64] FLAG: --event-qps="50" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781580 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781583 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781586 2570 flags.go:64] FLAG: --eviction-hard="" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781591 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781594 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781597 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781600 2570 flags.go:64] FLAG: --eviction-soft="" Jun 10 12:48:05.787320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781603 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781606 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781609 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781613 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781616 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781619 2570 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781622 2570 flags.go:64] FLAG: --feature-gates="" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781626 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781630 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781635 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781640 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781644 2570 flags.go:64] FLAG: --healthz-port="10248" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781648 2570 flags.go:64] FLAG: --help="false" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781651 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-140-135.ec2.internal" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781654 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781658 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781661 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781664 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781668 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781670 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781673 2570 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781676 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781679 2570 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 12:48:05.787933 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781682 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781686 2570 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781689 2570 flags.go:64] FLAG: --kube-reserved="" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781692 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781695 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781699 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781702 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781705 2570 flags.go:64] FLAG: --lock-file="" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781707 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781710 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781713 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781719 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781722 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781725 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781727 2570 flags.go:64] FLAG: --logging-format="text" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781730 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781734 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781736 2570 flags.go:64] FLAG: --manifest-url="" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781739 2570 flags.go:64] FLAG: --manifest-url-header="" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781744 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781747 2570 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781752 2570 flags.go:64] FLAG: --max-pods="110" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781755 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781758 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781761 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 12:48:05.788574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781764 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781767 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781770 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781773 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781780 2570 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781783 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781786 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781789 2570 flags.go:64] FLAG: --pod-cidr="" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781793 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781798 2570 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781801 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781804 2570 flags.go:64] FLAG: --pods-per-core="0" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781807 2570 flags.go:64] FLAG: --port="10250" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781811 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781814 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0909859e8b171ed95" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781817 2570 flags.go:64] FLAG: --qos-reserved="" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781820 2570 flags.go:64] FLAG: --read-only-port="10255" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781823 2570 flags.go:64] FLAG: --register-node="true" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781826 2570 flags.go:64] FLAG: --register-with-taints="" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781830 2570 flags.go:64] FLAG: --registry-burst="10" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781833 2570 flags.go:64] FLAG: --registry-qps="5" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781836 2570 flags.go:64] FLAG: --reserved-cpus="" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781839 2570 flags.go:64] FLAG: --reserved-memory="" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781843 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781846 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 12:48:05.789228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781849 2570 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781852 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781855 2570 flags.go:64] FLAG: --runonce="false" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781859 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781862 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781865 2570 flags.go:64] FLAG: --seccomp-default="false" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781868 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781871 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781886 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781890 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781893 2570 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781896 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781898 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781901 2570 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781904 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781907 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781911 2570 flags.go:64] FLAG: --system-cgroups="" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781914 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781919 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781922 2570 flags.go:64] FLAG: --tls-cert-file="" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781925 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781929 2570 flags.go:64] FLAG: --tls-min-version="" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781932 2570 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781935 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781938 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 12:48:05.790074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781941 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781944 2570 flags.go:64] FLAG: --v="2" Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781948 2570 flags.go:64] FLAG: --version="false" Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781952 2570 flags.go:64] FLAG: --vmodule="" Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781955 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.781959 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782078 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782082 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782085 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782087 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782092 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782095 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782098 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782100 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782103 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782105 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782108 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782110 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782113 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782116 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782118 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:48:05.791044 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782121 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782123 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782126 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782129 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782132 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782134 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782137 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782140 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782142 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782145 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782148 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782151 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782153 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782156 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782158 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782161 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782163 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782166 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782169 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782172 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:48:05.791571 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782174 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782178 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782182 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782186 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782189 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782192 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782196 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782199 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782201 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782204 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782207 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782210 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782212 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782215 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782218 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782220 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782223 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782226 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782229 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:48:05.792086 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782231 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782234 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782236 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782239 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782241 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782244 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782246 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782249 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782252 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782254 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782257 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782259 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782262 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782264 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782268 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782271 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782273 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782276 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782279 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:48:05.792601 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782282 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782285 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782289 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782292 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782295 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782298 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782300 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782303 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782306 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782308 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782311 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782314 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782317 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782320 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782323 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782326 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782329 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782332 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782335 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:48:05.793091 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782338 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782340 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782343 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782346 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782348 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782351 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.782353 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.783092 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.791679 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.791788 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.791809 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.791815 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791873 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791895 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791899 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:48:05.793566 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791903 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791906 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791909 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791912 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791915 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791918 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791921 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791924 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791927 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791929 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791932 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791935 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791937 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791940 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791943 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791946 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791949 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791952 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791954 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791958 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:48:05.793965 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791961 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791965 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791968 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791972 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791975 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791978 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791982 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791985 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791988 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791991 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791994 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.791997 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792000 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792003 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792005 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792008 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792011 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792015 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792019 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:48:05.794450 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792022 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792025 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792028 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792031 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792035 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792038 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792040 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792043 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792046 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792048 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792051 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792053 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792056 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792058 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792061 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792065 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792067 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792070 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792072 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792076 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:48:05.794920 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792078 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792081 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792084 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792088 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792092 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792095 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792098 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792101 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792104 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792107 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792110 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792112 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792115 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792118 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792120 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792123 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792126 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792129 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792132 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792135 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:48:05.795418 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792138 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792140 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792143 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792145 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792148 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792151 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792153 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792156 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792159 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792162 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792164 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792168 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792171 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792174 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792177 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792180 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:48:05.796011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792183 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.792188 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792323 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792330 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792333 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792336 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792338 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792341 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792344 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792347 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792349 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792352 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792355 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792358 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792361 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:48:05.796413 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792364 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792366 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792369 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792371 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792375 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792380 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792383 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792386 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792388 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792391 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792395 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792397 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792401 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792404 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792407 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792409 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792412 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792415 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792418 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:48:05.796779 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792420 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792423 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792426 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792428 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792431 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792433 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792436 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792439 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792441 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792444 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792447 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792449 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792452 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792456 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792458 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792461 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792464 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792466 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792469 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:48:05.797256 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792473 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792476 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792480 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792482 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792486 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792489 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792492 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792495 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792498 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792501 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792503 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792506 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792509 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792512 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792514 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792517 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792520 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792522 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792525 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792527 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:48:05.797704 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792530 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792533 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792535 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792538 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792540 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792543 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792546 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792549 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792552 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792554 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792557 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792559 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792562 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792564 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792567 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792569 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792572 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792575 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792578 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792581 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:48:05.798247 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792583 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792586 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792588 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792591 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792594 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792597 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792599 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:05.792602 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.792607 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.792737 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.794946 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.796349 2570 server.go:1019] "Starting client certificate rotation" Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.796454 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 12:48:05.798731 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.796493 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 12:48:05.799200 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.799186 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 12:48:05.800463 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.800439 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 12:48:05.811209 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.811183 2570 log.go:25] "Validated CRI v1 runtime API" Jun 10 12:48:05.814324 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.814304 2570 log.go:25] "Validated CRI v1 image API" Jun 10 12:48:05.815176 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.815150 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 12:48:05.818359 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.818339 2570 fs.go:135] Filesystem UUIDs: map[34780952-3e9f-4c44-8bc9-09b2614f87e9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7f340855-f038-4c06-b2a0-dd95d7cdde0e:/dev/nvme0n1p3] Jun 10 12:48:05.818424 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.818357 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 12:48:05.826003 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.825872 2570 manager.go:216] Machine: {Timestamp:2026-06-10 12:48:05.824141871 +0000 UTC m=+0.376666643 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091004 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b77d3e7510b8f624dbcfe2d19ed99 SystemUUID:ec2b77d3-e751-0b8f-624d-bcfe2d19ed99 BootID:ddc5bcb6-8ff0-4565-98a4-fe2210fc9412 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b6:9c:5c:3a:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b6:9c:5c:3a:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:3d:d4:7c:4e:7d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 12:48:05.826003 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.825993 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 12:48:05.826134 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.826075 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 12:48:05.827349 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.827332 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 12:48:05.830199 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.830168 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 12:48:05.830355 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.830203 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-135.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 12:48:05.831102 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.831092 2570 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 12:48:05.831135 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.831105 2570 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 12:48:05.831135 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.831112 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 12:48:05.831992 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.831982 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 12:48:05.832864 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.832854 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 12:48:05.835721 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.835710 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 10 12:48:05.835845 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.835835 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 12:48:05.835890 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.835866 2570 kubelet.go:486] "Attempting to sync node with API server" Jun 10 12:48:05.835928 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.835901 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 12:48:05.835928 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.835926 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 12:48:05.835994 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.835941 2570 kubelet.go:398] "Adding apiserver pod source" Jun 10 12:48:05.835994 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.835953 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 12:48:05.836397 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.836385 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 12:48:05.836437 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.836403 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 12:48:05.838941 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.838925 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 12:48:05.840375 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.840362 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 12:48:05.840414 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.840392 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 12:48:05.841594 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841581 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 12:48:05.841628 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841603 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 12:48:05.841628 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841612 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 12:48:05.841628 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841621 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 12:48:05.841701 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841633 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 12:48:05.841701 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841642 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 12:48:05.841701 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841653 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 12:48:05.841701 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841659 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 12:48:05.841701 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841669 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 12:48:05.841701 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841678 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 12:48:05.841701 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841692 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 12:48:05.841701 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.841697 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 12:48:05.843580 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.843568 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 12:48:05.843580 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.843580 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 12:48:05.845065 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.845032 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 12:48:05.845114 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.845050 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 12:48:05.846766 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.846753 2570 server.go:1268] "Started kubelet" Jun 10 12:48:05.846920 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.846854 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 12:48:05.846986 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.846851 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 12:48:05.846986 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.846943 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 12:48:05.847733 ip-10-0-140-135 systemd[1]: Started Kubernetes Kubelet. Jun 10 12:48:05.848925 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.848906 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-135.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 12:48:05.849010 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.848993 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 12:48:05.849064 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.849047 2570 server.go:310] "Adding debug handlers to kubelet server" Jun 10 12:48:05.854136 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.854118 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 12:48:05.854230 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.854165 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 12:48:05.854230 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.854176 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 12:48:05.854770 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.854231 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 10 12:48:05.854770 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.854732 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 12:48:05.854903 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.854816 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 12:48:05.854903 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.854831 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 12:48:05.854998 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.854950 2570 reconstruct.go:97] "Volume reconstruction finished" Jun 10 12:48:05.854998 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.854961 2570 reconciler.go:29] "Reconciler: start to sync state" Jun 10 12:48:05.855273 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.855259 2570 factory.go:153] Registering CRI-O factory Jun 10 12:48:05.855335 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.855277 2570 factory.go:223] Registration of the crio container factory successfully Jun 10 12:48:05.855335 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.855327 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 12:48:05.855430 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.855336 2570 factory.go:55] Registering systemd factory Jun 10 12:48:05.855430 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.855344 2570 factory.go:223] Registration of the systemd container factory successfully Jun 10 12:48:05.855430 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.855365 2570 factory.go:103] Registering Raw factory Jun 10 12:48:05.855430 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.855379 2570 manager.go:1196] Started watching for new ooms in manager Jun 10 12:48:05.855602 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.854302 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-135.ec2.internal.18b7b916f1dffdfc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-135.ec2.internal,UID:ip-10-0-140-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-135.ec2.internal,},FirstTimestamp:2026-06-10 12:48:05.846728188 +0000 UTC m=+0.399252958,LastTimestamp:2026-06-10 12:48:05.846728188 +0000 UTC m=+0.399252958,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-135.ec2.internal,}" Jun 10 12:48:05.855789 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.855776 2570 manager.go:349] Starting recovery of all containers Jun 10 12:48:05.857162 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.857136 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v2gns" Jun 10 12:48:05.857551 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.857529 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 12:48:05.857636 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.857604 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 12:48:05.865254 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.865233 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v2gns" Jun 10 12:48:05.868035 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.868017 2570 manager.go:354] Recovery completed Jun 10 12:48:05.872073 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.872061 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:48:05.873841 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.873824 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:48:05.873937 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.873858 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:48:05.873937 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.873887 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:48:05.874461 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.874447 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 12:48:05.874461 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.874459 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 12:48:05.874580 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.874469 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:48:05.874580 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.874473 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 10 12:48:05.875159 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.875141 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:48:05.875241 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.875171 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:48:05.875241 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.875185 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:48:05.875613 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.875600 2570 policy_none.go:49] "None policy: Start" Jun 10 12:48:05.875664 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.875617 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 12:48:05.875664 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.875628 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 12:48:05.876357 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.876249 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-135.ec2.internal.18b7b916f37dba9f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-135.ec2.internal,UID:ip-10-0-140-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-135.ec2.internal,},FirstTimestamp:2026-06-10 12:48:05.873842847 +0000 UTC m=+0.426367745,LastTimestamp:2026-06-10 12:48:05.873842847 +0000 UTC m=+0.426367745,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-135.ec2.internal,}" Jun 10 12:48:05.876555 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.876541 2570 policy_none.go:47] "Start" Jun 10 12:48:05.904506 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.904488 2570 manager.go:337] "Starting Device Plugin manager" Jun 10 12:48:05.919733 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.904557 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 12:48:05.919733 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.904571 2570 server.go:87] "Starting device plugin registration server" Jun 10 12:48:05.919733 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.904840 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 12:48:05.919733 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.904851 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 12:48:05.919733 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.904976 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 12:48:05.919733 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.905072 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 12:48:05.919733 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.905082 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 12:48:05.919733 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.905959 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 12:48:05.919733 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.906009 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-135.ec2.internal\" not found" Jun 10 12:48:05.921013 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.920984 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 12:48:05.922144 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.922124 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 12:48:05.922236 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.922172 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 12:48:05.922236 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.922198 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 12:48:05.922311 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:05.922280 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 12:48:05.924320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:05.924299 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:48:06.004979 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.004929 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:48:06.005940 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.005923 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:48:06.005940 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.005951 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:48:06.006083 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.005962 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:48:06.006083 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.005987 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.014406 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.014389 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.014453 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.014414 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-135.ec2.internal\": node \"ip-10-0-140-135.ec2.internal\" not found" Jun 10 12:48:06.022492 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.022440 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal"] Jun 10 12:48:06.022563 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.022503 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:48:06.023984 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.023969 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:48:06.024040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.023997 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:48:06.024040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.024009 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:48:06.025153 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.025140 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:48:06.025269 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.025245 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.025307 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.025283 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:48:06.025834 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.025819 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:48:06.025921 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.025846 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:48:06.025921 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.025855 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:48:06.025921 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.025860 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:48:06.025921 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.025872 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:48:06.025921 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.025902 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:48:06.027092 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.027077 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.027129 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.027107 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:48:06.027744 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.027728 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:48:06.027801 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.027761 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:48:06.027801 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.027777 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:48:06.028433 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.028418 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 10 12:48:06.051517 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.051492 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-135.ec2.internal\" not found" node="ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.055921 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.055902 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-135.ec2.internal\" not found" node="ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.056932 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.056915 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.057002 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.056939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.057002 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.056959 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2800005ebd22734ffdd825485f6a9839-config\") pod \"kube-apiserver-proxy-ip-10-0-140-135.ec2.internal\" (UID: \"2800005ebd22734ffdd825485f6a9839\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.129260 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.129229 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 10 12:48:06.157594 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.157567 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.157773 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.157602 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2800005ebd22734ffdd825485f6a9839-config\") pod \"kube-apiserver-proxy-ip-10-0-140-135.ec2.internal\" (UID: \"2800005ebd22734ffdd825485f6a9839\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.157773 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.157638 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.157773 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.157665 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.157773 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.157690 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27c5d6ad4d3c1d724ac8db31730eac59-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal\" (UID: \"27c5d6ad4d3c1d724ac8db31730eac59\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.157773 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.157698 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2800005ebd22734ffdd825485f6a9839-config\") pod \"kube-apiserver-proxy-ip-10-0-140-135.ec2.internal\" (UID: \"2800005ebd22734ffdd825485f6a9839\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.229661 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.229623 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 10 12:48:06.330348 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.330273 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 10 12:48:06.355699 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.355666 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.360548 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.360528 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.431198 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.431161 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 10 12:48:06.531672 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.531639 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 10 12:48:06.632194 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.632113 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-135.ec2.internal\" not found" Jun 10 12:48:06.663230 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.663205 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:48:06.755310 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.755279 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.770294 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.768816 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 12:48:06.773948 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.773909 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" Jun 10 12:48:06.785372 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.785352 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 12:48:06.795698 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.795671 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 12:48:06.795897 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.795857 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 12:48:06.795961 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.795858 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 12:48:06.836089 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.836061 2570 apiserver.go:52] "Watching apiserver" Jun 10 12:48:06.847892 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:06.847855 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c5d6ad4d3c1d724ac8db31730eac59.slice/crio-db739676daddbee41791608d5f0de67ed3506bb2a3035baabfa059f10a10a84e WatchSource:0}: Error finding container db739676daddbee41791608d5f0de67ed3506bb2a3035baabfa059f10a10a84e: Status 404 returned error can't find the container with id db739676daddbee41791608d5f0de67ed3506bb2a3035baabfa059f10a10a84e Jun 10 12:48:06.848285 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:06.848257 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2800005ebd22734ffdd825485f6a9839.slice/crio-b148538c1ba03a600319c6cf22f8ae899e132ab65be84d3487b41d7bf667ba05 WatchSource:0}: Error finding container b148538c1ba03a600319c6cf22f8ae899e132ab65be84d3487b41d7bf667ba05: Status 404 returned error can't find the container with id b148538c1ba03a600319c6cf22f8ae899e132ab65be84d3487b41d7bf667ba05 Jun 10 12:48:06.852037 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.852014 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 12:48:06.852563 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.852433 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-ds6pq","kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7","openshift-multus/network-metrics-daemon-pgwrf","openshift-network-operator/iptables-alerter-ljx5n","openshift-cluster-node-tuning-operator/tuned-7grq6","openshift-dns/node-resolver-fr9j5","openshift-image-registry/node-ca-76fjd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal","openshift-multus/multus-additional-cni-plugins-h6p7s","openshift-multus/multus-qxgn4","openshift-network-diagnostics/network-check-target-7qqkc","openshift-ovn-kubernetes/ovnkube-node-2lkfl","kube-system/global-pull-secret-syncer-gtzj7"] Jun 10 12:48:06.852899 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.852869 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:48:06.854286 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.854267 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 12:48:06.854395 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.854380 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:06.855584 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.855519 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.856694 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.856680 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:06.856793 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.856741 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:06.856847 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.856799 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-psfkb\"" Jun 10 12:48:06.856903 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.856856 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 12:48:06.857114 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.857099 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 12:48:06.857970 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.857955 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:06.858411 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.858391 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 12:48:06.858500 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.858457 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 12:48:06.859215 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.859194 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.859627 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.859612 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wvbf9\"" Jun 10 12:48:06.859912 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.859898 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 12:48:06.860454 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.860439 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-socket-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.860515 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.860470 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-registration-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.860570 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.860516 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:06.860570 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.860519 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.860570 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.860557 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/585f27a5-5755-4e14-868d-7b3f3c67d71d-konnectivity-ca\") pod \"konnectivity-agent-ds6pq\" (UID: \"585f27a5-5755-4e14-868d-7b3f3c67d71d\") " pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:06.860708 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.860583 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-device-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.860708 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.860608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-sys-fs\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.860708 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.860631 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whp9j\" (UniqueName: \"kubernetes.io/projected/f7c35aaf-e876-485a-8011-f55971ab3fb9-kube-api-access-whp9j\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.860708 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.860677 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/585f27a5-5755-4e14-868d-7b3f3c67d71d-agent-certs\") pod \"konnectivity-agent-ds6pq\" (UID: \"585f27a5-5755-4e14-868d-7b3f3c67d71d\") " pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:06.860854 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.860708 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.861843 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.861829 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:06.862224 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.862202 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:48:06.862349 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.862273 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:48:06.862349 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.862279 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 12:48:06.862932 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.862765 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 12:48:06.863044 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.862930 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k2jsf\"" Jun 10 12:48:06.863044 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.862959 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 12:48:06.863203 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.863180 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 12:48:06.863290 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.863208 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ksn79\"" Jun 10 12:48:06.863290 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.863246 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8b5cb\"" Jun 10 12:48:06.863537 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.863510 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:06.864070 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.864049 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 12:48:06.864989 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.864944 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.865212 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.865066 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 12:48:06.866252 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.866235 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:06.866345 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.866281 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:06.867722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.867453 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qsrp6\"" Jun 10 12:48:06.867722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.867540 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 12:48:06.867722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.867552 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 12:48:06.867722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.867613 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.868253 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.868233 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 12:48:06.868404 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.868375 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 12:43:05 +0000 UTC" deadline="2027-11-25 06:10:09.384099001 +0000 UTC" Jun 10 12:48:06.868469 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.868406 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12785h22m2.515697625s" Jun 10 12:48:06.868549 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.868534 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 12:48:06.868754 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.868738 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lth5x\"" Jun 10 12:48:06.869267 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.869001 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tm58f\"" Jun 10 12:48:06.869866 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.869720 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 12:48:06.870038 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.870022 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 12:48:06.870749 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.870574 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 12:48:06.871140 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.870831 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 12:48:06.871270 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.871256 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:06.871381 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:06.871333 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:06.873755 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.873719 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 12:48:06.873902 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.873871 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q4n4d\"" Jun 10 12:48:06.874595 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.874572 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 12:48:06.874682 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.874614 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 12:48:06.874682 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.874636 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 12:48:06.874862 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.874848 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 12:48:06.875014 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.875003 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 12:48:06.877283 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.877268 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 12:48:06.909394 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.909376 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g4fbq" Jun 10 12:48:06.918073 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.918055 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g4fbq" Jun 10 12:48:06.925944 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.925904 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" event={"ID":"2800005ebd22734ffdd825485f6a9839","Type":"ContainerStarted","Data":"b148538c1ba03a600319c6cf22f8ae899e132ab65be84d3487b41d7bf667ba05"} Jun 10 12:48:06.927068 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.927049 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" event={"ID":"27c5d6ad4d3c1d724ac8db31730eac59","Type":"ContainerStarted","Data":"db739676daddbee41791608d5f0de67ed3506bb2a3035baabfa059f10a10a84e"} Jun 10 12:48:06.956325 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.956302 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 12:48:06.961782 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961767 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-node-log\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.961841 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961790 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.961841 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t498\" (UniqueName: \"kubernetes.io/projected/6c3fcff8-c57e-4735-9479-a68e74020927-kube-api-access-2t498\") pod \"iptables-alerter-ljx5n\" (UID: \"6c3fcff8-c57e-4735-9479-a68e74020927\") " pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:06.961841 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961822 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-lib-modules\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.961841 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961837 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/860e986c-5515-492c-8b7a-fd084ede0dbf-hosts-file\") pod \"node-resolver-fr9j5\" (UID: \"860e986c-5515-492c-8b7a-fd084ede0dbf\") " pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:06.961979 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961895 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/727d6207-33ea-4612-8898-b513031d9bc4-host\") pod \"node-ca-76fjd\" (UID: \"727d6207-33ea-4612-8898-b513031d9bc4\") " pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:06.961979 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961925 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-var-lib-cni-multus\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.961979 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961947 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-hostroot\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.961979 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961961 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-os-release\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:06.961979 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961976 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-system-cni-dir\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.962125 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.961997 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-cnibin\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.962125 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962029 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-daemon-config\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.962125 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962046 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-etc-kubernetes\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.962125 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962066 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.962125 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962082 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.962125 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962104 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-run-openvswitch\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.962289 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962158 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.962289 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962184 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-run-ovn\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.962289 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962193 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.962289 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962213 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-sysctl-d\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.962289 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962235 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-var-lib-kubelet\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.962289 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962251 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:06.962451 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962299 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.962451 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-kubernetes\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.962451 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962333 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8q9w\" (UniqueName: \"kubernetes.io/projected/727d6207-33ea-4612-8898-b513031d9bc4-kube-api-access-d8q9w\") pod \"node-ca-76fjd\" (UID: \"727d6207-33ea-4612-8898-b513031d9bc4\") " pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:06.962451 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962352 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-system-cni-dir\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:06.962451 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:06.962451 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962402 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-cni-dir\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.962451 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962427 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-registration-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.962451 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962448 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dccf8486-5e33-4ec9-9242-de7a7c2b3347-ovnkube-config\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962470 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-registration-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962500 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-sysctl-conf\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962517 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p4rx\" (UniqueName: \"kubernetes.io/projected/860e986c-5515-492c-8b7a-fd084ede0dbf-kube-api-access-2p4rx\") pod \"node-resolver-fr9j5\" (UID: \"860e986c-5515-492c-8b7a-fd084ede0dbf\") " pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962532 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dccf8486-5e33-4ec9-9242-de7a7c2b3347-ovnkube-script-lib\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962555 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c3fcff8-c57e-4735-9479-a68e74020927-iptables-alerter-script\") pod \"iptables-alerter-ljx5n\" (UID: \"6c3fcff8-c57e-4735-9479-a68e74020927\") " pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962568 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-var-lib-cni-bin\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962584 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwvxw\" (UniqueName: \"kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw\") pod \"network-check-target-7qqkc\" (UID: \"fa74edf9-3c07-49b3-91a3-94d824bb0ea4\") " pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962602 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/585f27a5-5755-4e14-868d-7b3f3c67d71d-agent-certs\") pod \"konnectivity-agent-ds6pq\" (UID: \"585f27a5-5755-4e14-868d-7b3f3c67d71d\") " pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-log-socket\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962630 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-run\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962643 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-host\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.962659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962658 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-cnibin\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:06.963040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962674 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-run-netns\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.963040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962825 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-run-systemd\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.963040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962857 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/340d0d25-8681-4a5e-bfbe-28f439bbfd89-dbus\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:06.963040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-var-lib-kubelet\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.963040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962940 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgq8x\" (UniqueName: \"kubernetes.io/projected/dccf8486-5e33-4ec9-9242-de7a7c2b3347-kube-api-access-zgq8x\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.963040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962948 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 12:48:06.963040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962974 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-sys\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.963040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.962994 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-tmp\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.963040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963007 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/727d6207-33ea-4612-8898-b513031d9bc4-serviceca\") pod \"node-ca-76fjd\" (UID: \"727d6207-33ea-4612-8898-b513031d9bc4\") " pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963047 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963066 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sc6x\" (UniqueName: \"kubernetes.io/projected/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-kube-api-access-4sc6x\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963084 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-run-k8s-cni-cncf-io\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963127 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-run-multus-certs\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963162 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/585f27a5-5755-4e14-868d-7b3f3c67d71d-konnectivity-ca\") pod \"konnectivity-agent-ds6pq\" (UID: \"585f27a5-5755-4e14-868d-7b3f3c67d71d\") " pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963189 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-kubelet\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963227 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dccf8486-5e33-4ec9-9242-de7a7c2b3347-ovn-node-metrics-cert\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963254 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c3fcff8-c57e-4735-9479-a68e74020927-host-slash\") pod \"iptables-alerter-ljx5n\" (UID: \"6c3fcff8-c57e-4735-9479-a68e74020927\") " pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963277 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-systemd\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963302 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-conf-dir\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963326 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw8bh\" (UniqueName: \"kubernetes.io/projected/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-kube-api-access-xw8bh\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963357 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-modprobe-d\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963382 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-socket-dir-parent\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963408 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-device-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963437 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-run-netns\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.963456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963461 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-sysconfig\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963484 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-tuned\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963494 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-device-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963527 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-systemd-units\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963549 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-slash\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963564 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-cni-bin\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963585 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-cni-netd\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963600 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dccf8486-5e33-4ec9-9242-de7a7c2b3347-env-overrides\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963631 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-os-release\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963683 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-etc-openvswitch\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963686 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/585f27a5-5755-4e14-868d-7b3f3c67d71d-konnectivity-ca\") pod \"konnectivity-agent-ds6pq\" (UID: \"585f27a5-5755-4e14-868d-7b3f3c67d71d\") " pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.963714 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/340d0d25-8681-4a5e-bfbe-28f439bbfd89-kubelet-config\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/860e986c-5515-492c-8b7a-fd084ede0dbf-tmp-dir\") pod \"node-resolver-fr9j5\" (UID: \"860e986c-5515-492c-8b7a-fd084ede0dbf\") " pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964040 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964069 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:06.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964111 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-socket-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.964674 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964140 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c67rg\" (UniqueName: \"kubernetes.io/projected/19924bce-75e7-45a1-8222-5f6b693f9dc4-kube-api-access-c67rg\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:06.964674 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964165 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-cni-binary-copy\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:06.964674 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964191 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-sys-fs\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.964674 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964219 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-socket-dir\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.964674 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964226 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whp9j\" (UniqueName: \"kubernetes.io/projected/f7c35aaf-e876-485a-8011-f55971ab3fb9-kube-api-access-whp9j\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.964674 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964255 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f7c35aaf-e876-485a-8011-f55971ab3fb9-sys-fs\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:06.964674 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964259 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-var-lib-openvswitch\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:06.964674 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.964299 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs9nx\" (UniqueName: \"kubernetes.io/projected/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-kube-api-access-fs9nx\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:06.965963 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.965948 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/585f27a5-5755-4e14-868d-7b3f3c67d71d-agent-certs\") pod \"konnectivity-agent-ds6pq\" (UID: \"585f27a5-5755-4e14-868d-7b3f3c67d71d\") " pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:06.973776 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:06.973759 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whp9j\" (UniqueName: \"kubernetes.io/projected/f7c35aaf-e876-485a-8011-f55971ab3fb9-kube-api-access-whp9j\") pod \"aws-ebs-csi-driver-node-28jq7\" (UID: \"f7c35aaf-e876-485a-8011-f55971ab3fb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:07.064629 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064599 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dccf8486-5e33-4ec9-9242-de7a7c2b3347-ovnkube-config\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.064629 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064631 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-sysctl-conf\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.064906 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064648 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p4rx\" (UniqueName: \"kubernetes.io/projected/860e986c-5515-492c-8b7a-fd084ede0dbf-kube-api-access-2p4rx\") pod \"node-resolver-fr9j5\" (UID: \"860e986c-5515-492c-8b7a-fd084ede0dbf\") " pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:07.064906 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064663 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dccf8486-5e33-4ec9-9242-de7a7c2b3347-ovnkube-script-lib\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.064906 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064678 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c3fcff8-c57e-4735-9479-a68e74020927-iptables-alerter-script\") pod \"iptables-alerter-ljx5n\" (UID: \"6c3fcff8-c57e-4735-9479-a68e74020927\") " pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:07.064906 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064800 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-var-lib-cni-bin\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.064906 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064839 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvxw\" (UniqueName: \"kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw\") pod \"network-check-target-7qqkc\" (UID: \"fa74edf9-3c07-49b3-91a3-94d824bb0ea4\") " pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:07.064906 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064857 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-sysctl-conf\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.064906 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064866 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-log-socket\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064935 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-run\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064965 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-host\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.064998 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-log-socket\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065018 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-host\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065018 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-run\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065056 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-var-lib-cni-bin\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065077 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-cnibin\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065098 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-run-netns\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065130 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-run-netns\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065131 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-run-systemd\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065143 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-cnibin\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065159 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/340d0d25-8681-4a5e-bfbe-28f439bbfd89-dbus\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065176 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-var-lib-kubelet\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065179 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-run-systemd\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065194 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgq8x\" (UniqueName: \"kubernetes.io/projected/dccf8486-5e33-4ec9-9242-de7a7c2b3347-kube-api-access-zgq8x\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065218 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-sys\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065228 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-var-lib-kubelet\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.065265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065218 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/340d0d25-8681-4a5e-bfbe-28f439bbfd89-dbus\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065265 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-sys\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065284 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6c3fcff8-c57e-4735-9479-a68e74020927-iptables-alerter-script\") pod \"iptables-alerter-ljx5n\" (UID: \"6c3fcff8-c57e-4735-9479-a68e74020927\") " pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065316 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-tmp\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065333 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dccf8486-5e33-4ec9-9242-de7a7c2b3347-ovnkube-config\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065340 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dccf8486-5e33-4ec9-9242-de7a7c2b3347-ovnkube-script-lib\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065346 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/727d6207-33ea-4612-8898-b513031d9bc4-serviceca\") pod \"node-ca-76fjd\" (UID: \"727d6207-33ea-4612-8898-b513031d9bc4\") " pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065386 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065410 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sc6x\" (UniqueName: \"kubernetes.io/projected/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-kube-api-access-4sc6x\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065430 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-run-k8s-cni-cncf-io\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065451 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-run-multus-certs\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065476 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-kubelet\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065481 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-run-k8s-cni-cncf-io\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065499 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dccf8486-5e33-4ec9-9242-de7a7c2b3347-ovn-node-metrics-cert\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065529 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-run-multus-certs\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065536 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-kubelet\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065574 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c3fcff8-c57e-4735-9479-a68e74020927-host-slash\") pod \"iptables-alerter-ljx5n\" (UID: \"6c3fcff8-c57e-4735-9479-a68e74020927\") " pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:07.066156 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065599 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-systemd\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065640 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-conf-dir\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065643 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-systemd\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065581 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6c3fcff8-c57e-4735-9479-a68e74020927-host-slash\") pod \"iptables-alerter-ljx5n\" (UID: \"6c3fcff8-c57e-4735-9479-a68e74020927\") " pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065663 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw8bh\" (UniqueName: \"kubernetes.io/projected/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-kube-api-access-xw8bh\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065688 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-conf-dir\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065719 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-modprobe-d\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065746 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-socket-dir-parent\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065775 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-run-netns\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065798 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-sysconfig\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065803 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/727d6207-33ea-4612-8898-b513031d9bc4-serviceca\") pod \"node-ca-76fjd\" (UID: \"727d6207-33ea-4612-8898-b513031d9bc4\") " pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065819 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-tuned\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065852 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-modprobe-d\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065855 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-systemd-units\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065895 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065906 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-slash\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065931 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-cni-bin\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065929 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-socket-dir-parent\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.067088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065959 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-cni-netd\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065967 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-slash\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065969 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-sysconfig\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dccf8486-5e33-4ec9-9242-de7a7c2b3347-env-overrides\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065932 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-systemd-units\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.065985 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-run-netns\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066003 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-cni-bin\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066023 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066041 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-cni-netd\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066051 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-os-release\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066076 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-etc-openvswitch\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066114 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-etc-openvswitch\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.066117 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066139 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/340d0d25-8681-4a5e-bfbe-28f439bbfd89-kubelet-config\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066165 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/860e986c-5515-492c-8b7a-fd084ede0dbf-tmp-dir\") pod \"node-resolver-fr9j5\" (UID: \"860e986c-5515-492c-8b7a-fd084ede0dbf\") " pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066196 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066212 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/340d0d25-8681-4a5e-bfbe-28f439bbfd89-kubelet-config\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:07.067795 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.066236 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret podName:340d0d25-8681-4a5e-bfbe-28f439bbfd89 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:07.566214589 +0000 UTC m=+2.118739348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret") pod "global-pull-secret-syncer-gtzj7" (UID: "340d0d25-8681-4a5e-bfbe-28f439bbfd89") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066271 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066299 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c67rg\" (UniqueName: \"kubernetes.io/projected/19924bce-75e7-45a1-8222-5f6b693f9dc4-kube-api-access-c67rg\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066327 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-cni-binary-copy\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066367 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-var-lib-openvswitch\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066367 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dccf8486-5e33-4ec9-9242-de7a7c2b3347-env-overrides\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066423 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs9nx\" (UniqueName: \"kubernetes.io/projected/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-kube-api-access-fs9nx\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066436 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-var-lib-openvswitch\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066452 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-node-log\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066479 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066510 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066520 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t498\" (UniqueName: \"kubernetes.io/projected/6c3fcff8-c57e-4735-9479-a68e74020927-kube-api-access-2t498\") pod \"iptables-alerter-ljx5n\" (UID: \"6c3fcff8-c57e-4735-9479-a68e74020927\") " pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066550 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-lib-modules\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066584 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/860e986c-5515-492c-8b7a-fd084ede0dbf-hosts-file\") pod \"node-resolver-fr9j5\" (UID: \"860e986c-5515-492c-8b7a-fd084ede0dbf\") " pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066609 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/727d6207-33ea-4612-8898-b513031d9bc4-host\") pod \"node-ca-76fjd\" (UID: \"727d6207-33ea-4612-8898-b513031d9bc4\") " pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066632 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-var-lib-cni-multus\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066656 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-hostroot\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066664 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-node-log\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066680 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-os-release\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066491 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/860e986c-5515-492c-8b7a-fd084ede0dbf-tmp-dir\") pod \"node-resolver-fr9j5\" (UID: \"860e986c-5515-492c-8b7a-fd084ede0dbf\") " pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066705 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-system-cni-dir\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066741 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-cnibin\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066760 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-system-cni-dir\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066767 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-daemon-config\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066792 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-etc-kubernetes\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066837 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-run-openvswitch\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066857 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-lib-modules\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066857 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066872 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-host-var-lib-cni-multus\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066942 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-run-openvswitch\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066947 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/860e986c-5515-492c-8b7a-fd084ede0dbf-hosts-file\") pod \"node-resolver-fr9j5\" (UID: \"860e986c-5515-492c-8b7a-fd084ede0dbf\") " pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066962 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-os-release\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066974 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/727d6207-33ea-4612-8898-b513031d9bc4-host\") pod \"node-ca-76fjd\" (UID: \"727d6207-33ea-4612-8898-b513031d9bc4\") " pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066996 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-etc-kubernetes\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067008 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-hostroot\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.068790 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.066863 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-run-ovn\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067038 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-sysctl-d\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067045 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-run-ovn-kubernetes\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067063 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-var-lib-kubelet\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067085 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067105 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067130 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-kubernetes\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067140 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-sysctl-d\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067154 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8q9w\" (UniqueName: \"kubernetes.io/projected/727d6207-33ea-4612-8898-b513031d9bc4-kube-api-access-d8q9w\") pod \"node-ca-76fjd\" (UID: \"727d6207-33ea-4612-8898-b513031d9bc4\") " pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067179 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-system-cni-dir\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067203 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.067211 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067228 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-cni-dir\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.067265 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs podName:19924bce-75e7-45a1-8222-5f6b693f9dc4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:07.567251676 +0000 UTC m=+2.119776445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs") pod "network-metrics-daemon-pgwrf" (UID: "19924bce-75e7-45a1-8222-5f6b693f9dc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067317 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-cni-dir\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067317 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-kubernetes\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067350 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-cni-binary-copy\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.069304 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067364 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-system-cni-dir\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.069764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067364 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-var-lib-kubelet\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.069764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067395 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.069764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067398 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-multus-daemon-config\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.069764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067524 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-os-release\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.069764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067460 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-cnibin\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.069764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067541 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dccf8486-5e33-4ec9-9242-de7a7c2b3347-run-ovn\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.069764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.067761 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.069764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.068050 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-tmp\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.069764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.068164 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-etc-tuned\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.069764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.068227 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dccf8486-5e33-4ec9-9242-de7a7c2b3347-ovn-node-metrics-cert\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.074250 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.074228 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:48:07.074250 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.074249 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:48:07.074388 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.074259 2570 projected.go:196] Error preparing data for projected volume kube-api-access-xwvxw for pod openshift-network-diagnostics/network-check-target-7qqkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:07.074388 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.074331 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw podName:fa74edf9-3c07-49b3-91a3-94d824bb0ea4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:07.574320848 +0000 UTC m=+2.126845607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xwvxw" (UniqueName: "kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw") pod "network-check-target-7qqkc" (UID: "fa74edf9-3c07-49b3-91a3-94d824bb0ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:07.076862 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.076843 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs9nx\" (UniqueName: \"kubernetes.io/projected/f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1-kube-api-access-fs9nx\") pod \"tuned-7grq6\" (UID: \"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1\") " pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.079412 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.079388 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgq8x\" (UniqueName: \"kubernetes.io/projected/dccf8486-5e33-4ec9-9242-de7a7c2b3347-kube-api-access-zgq8x\") pod \"ovnkube-node-2lkfl\" (UID: \"dccf8486-5e33-4ec9-9242-de7a7c2b3347\") " pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.080479 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.080461 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sc6x\" (UniqueName: \"kubernetes.io/projected/40985e58-d53c-4ddb-8b4c-8bf40c46aa5d-kube-api-access-4sc6x\") pod \"multus-additional-cni-plugins-h6p7s\" (UID: \"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d\") " pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.080613 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.080587 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c67rg\" (UniqueName: \"kubernetes.io/projected/19924bce-75e7-45a1-8222-5f6b693f9dc4-kube-api-access-c67rg\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:07.080915 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.080895 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8q9w\" (UniqueName: \"kubernetes.io/projected/727d6207-33ea-4612-8898-b513031d9bc4-kube-api-access-d8q9w\") pod \"node-ca-76fjd\" (UID: \"727d6207-33ea-4612-8898-b513031d9bc4\") " pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:07.082622 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.082603 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p4rx\" (UniqueName: \"kubernetes.io/projected/860e986c-5515-492c-8b7a-fd084ede0dbf-kube-api-access-2p4rx\") pod \"node-resolver-fr9j5\" (UID: \"860e986c-5515-492c-8b7a-fd084ede0dbf\") " pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:07.085169 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.085148 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t498\" (UniqueName: \"kubernetes.io/projected/6c3fcff8-c57e-4735-9479-a68e74020927-kube-api-access-2t498\") pod \"iptables-alerter-ljx5n\" (UID: \"6c3fcff8-c57e-4735-9479-a68e74020927\") " pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:07.086321 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.086306 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw8bh\" (UniqueName: \"kubernetes.io/projected/c09c65d1-5f9e-4ae3-9a4b-7451e4e56963-kube-api-access-xw8bh\") pod \"multus-qxgn4\" (UID: \"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963\") " pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.143509 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.143427 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:48:07.166759 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.166726 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:07.172960 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.172938 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" Jun 10 12:48:07.175944 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:07.175914 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585f27a5_5755_4e14_868d_7b3f3c67d71d.slice/crio-f724fdf1cd3dbd5ded83cfb93e1caf504c0c64f074c08cee89a255cd4853db1e WatchSource:0}: Error finding container f724fdf1cd3dbd5ded83cfb93e1caf504c0c64f074c08cee89a255cd4853db1e: Status 404 returned error can't find the container with id f724fdf1cd3dbd5ded83cfb93e1caf504c0c64f074c08cee89a255cd4853db1e Jun 10 12:48:07.180479 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.180456 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ljx5n" Jun 10 12:48:07.182608 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:07.182575 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c35aaf_e876_485a_8011_f55971ab3fb9.slice/crio-c0ba35d43679cc1f5903a217a2977371238b7d4db3adb49d72e3814cf57c6380 WatchSource:0}: Error finding container c0ba35d43679cc1f5903a217a2977371238b7d4db3adb49d72e3814cf57c6380: Status 404 returned error can't find the container with id c0ba35d43679cc1f5903a217a2977371238b7d4db3adb49d72e3814cf57c6380 Jun 10 12:48:07.185107 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.185087 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7grq6" Jun 10 12:48:07.189691 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.189670 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fr9j5" Jun 10 12:48:07.190672 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:07.190649 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3fcff8_c57e_4735_9479_a68e74020927.slice/crio-929c862d93355716877a6950822ea7709115473bb6aca371faa93ffc99398d38 WatchSource:0}: Error finding container 929c862d93355716877a6950822ea7709115473bb6aca371faa93ffc99398d38: Status 404 returned error can't find the container with id 929c862d93355716877a6950822ea7709115473bb6aca371faa93ffc99398d38 Jun 10 12:48:07.193954 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:07.193929 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6aac403_a1ac_461d_bd7b_1eb5d0d1bfb1.slice/crio-2f186fb2b28012957547385001b4801545e75c3efee20fd4329582c78681ac7a WatchSource:0}: Error finding container 2f186fb2b28012957547385001b4801545e75c3efee20fd4329582c78681ac7a: Status 404 returned error can't find the container with id 2f186fb2b28012957547385001b4801545e75c3efee20fd4329582c78681ac7a Jun 10 12:48:07.194744 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.194646 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-76fjd" Jun 10 12:48:07.199152 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:07.199131 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860e986c_5515_492c_8b7a_fd084ede0dbf.slice/crio-99a7d53267fc71e7571249f90ecb2077a982afa29cb0546ab7e0307854fb67c3 WatchSource:0}: Error finding container 99a7d53267fc71e7571249f90ecb2077a982afa29cb0546ab7e0307854fb67c3: Status 404 returned error can't find the container with id 99a7d53267fc71e7571249f90ecb2077a982afa29cb0546ab7e0307854fb67c3 Jun 10 12:48:07.199416 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.199397 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" Jun 10 12:48:07.204460 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:07.204421 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727d6207_33ea_4612_8898_b513031d9bc4.slice/crio-98896e64b86b43d8daa63fe5213a0e2ed390625087b1b65a239b3cc4be321b0a WatchSource:0}: Error finding container 98896e64b86b43d8daa63fe5213a0e2ed390625087b1b65a239b3cc4be321b0a: Status 404 returned error can't find the container with id 98896e64b86b43d8daa63fe5213a0e2ed390625087b1b65a239b3cc4be321b0a Jun 10 12:48:07.205258 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.205237 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qxgn4" Jun 10 12:48:07.209808 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.209787 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:07.210011 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:07.209990 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40985e58_d53c_4ddb_8b4c_8bf40c46aa5d.slice/crio-435df72baba31f4678eac9d95a0b09f4340a5ee2ff10e31fcf76cf88b10ea4c6 WatchSource:0}: Error finding container 435df72baba31f4678eac9d95a0b09f4340a5ee2ff10e31fcf76cf88b10ea4c6: Status 404 returned error can't find the container with id 435df72baba31f4678eac9d95a0b09f4340a5ee2ff10e31fcf76cf88b10ea4c6 Jun 10 12:48:07.215313 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:07.215293 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc09c65d1_5f9e_4ae3_9a4b_7451e4e56963.slice/crio-bceb9993c9755997006de0a03c6340366fd67adb270847c52b3aa3441cd9c408 WatchSource:0}: Error finding container bceb9993c9755997006de0a03c6340366fd67adb270847c52b3aa3441cd9c408: Status 404 returned error can't find the container with id bceb9993c9755997006de0a03c6340366fd67adb270847c52b3aa3441cd9c408 Jun 10 12:48:07.220054 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:07.220030 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddccf8486_5e33_4ec9_9242_de7a7c2b3347.slice/crio-db048f1346139978de8726d5e49462ca26d7249b73555736e11f45b5392570de WatchSource:0}: Error finding container db048f1346139978de8726d5e49462ca26d7249b73555736e11f45b5392570de: Status 404 returned error can't find the container with id db048f1346139978de8726d5e49462ca26d7249b73555736e11f45b5392570de Jun 10 12:48:07.412485 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.412372 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:48:07.572433 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.571539 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:07.572433 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.571622 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:07.572433 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.571761 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:07.572433 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.571823 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret podName:340d0d25-8681-4a5e-bfbe-28f439bbfd89 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:08.571804347 +0000 UTC m=+3.124329108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret") pod "global-pull-secret-syncer-gtzj7" (UID: "340d0d25-8681-4a5e-bfbe-28f439bbfd89") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:07.572433 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.572344 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:07.572433 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.572406 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs podName:19924bce-75e7-45a1-8222-5f6b693f9dc4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:08.572388143 +0000 UTC m=+3.124912902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs") pod "network-metrics-daemon-pgwrf" (UID: "19924bce-75e7-45a1-8222-5f6b693f9dc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:07.673418 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.672891 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvxw\" (UniqueName: \"kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw\") pod \"network-check-target-7qqkc\" (UID: \"fa74edf9-3c07-49b3-91a3-94d824bb0ea4\") " pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:07.673418 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.673074 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:48:07.673418 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.673098 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:48:07.673418 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.673114 2570 projected.go:196] Error preparing data for projected volume kube-api-access-xwvxw for pod openshift-network-diagnostics/network-check-target-7qqkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:07.673418 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.673170 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw podName:fa74edf9-3c07-49b3-91a3-94d824bb0ea4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:08.673152834 +0000 UTC m=+3.225677597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwvxw" (UniqueName: "kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw") pod "network-check-target-7qqkc" (UID: "fa74edf9-3c07-49b3-91a3-94d824bb0ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:07.920858 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.920759 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:43:06 +0000 UTC" deadline="2028-02-04 07:34:00.53250452 +0000 UTC" Jun 10 12:48:07.920858 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.920800 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14490h45m52.611708979s" Jun 10 12:48:07.925539 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.922655 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:07.925539 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:07.922774 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:07.957383 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.957341 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-76fjd" event={"ID":"727d6207-33ea-4612-8898-b513031d9bc4","Type":"ContainerStarted","Data":"98896e64b86b43d8daa63fe5213a0e2ed390625087b1b65a239b3cc4be321b0a"} Jun 10 12:48:07.976834 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:07.976796 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fr9j5" event={"ID":"860e986c-5515-492c-8b7a-fd084ede0dbf","Type":"ContainerStarted","Data":"99a7d53267fc71e7571249f90ecb2077a982afa29cb0546ab7e0307854fb67c3"} Jun 10 12:48:08.002307 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.002210 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" event={"ID":"f7c35aaf-e876-485a-8011-f55971ab3fb9","Type":"ContainerStarted","Data":"c0ba35d43679cc1f5903a217a2977371238b7d4db3adb49d72e3814cf57c6380"} Jun 10 12:48:08.020109 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.020069 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ds6pq" event={"ID":"585f27a5-5755-4e14-868d-7b3f3c67d71d","Type":"ContainerStarted","Data":"f724fdf1cd3dbd5ded83cfb93e1caf504c0c64f074c08cee89a255cd4853db1e"} Jun 10 12:48:08.031896 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.028037 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:48:08.033402 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.033188 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" event={"ID":"dccf8486-5e33-4ec9-9242-de7a7c2b3347","Type":"ContainerStarted","Data":"db048f1346139978de8726d5e49462ca26d7249b73555736e11f45b5392570de"} Jun 10 12:48:08.057239 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.057172 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" event={"ID":"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d","Type":"ContainerStarted","Data":"435df72baba31f4678eac9d95a0b09f4340a5ee2ff10e31fcf76cf88b10ea4c6"} Jun 10 12:48:08.080750 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.080709 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7grq6" event={"ID":"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1","Type":"ContainerStarted","Data":"2f186fb2b28012957547385001b4801545e75c3efee20fd4329582c78681ac7a"} Jun 10 12:48:08.112216 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.112183 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ljx5n" event={"ID":"6c3fcff8-c57e-4735-9479-a68e74020927","Type":"ContainerStarted","Data":"929c862d93355716877a6950822ea7709115473bb6aca371faa93ffc99398d38"} Jun 10 12:48:08.128025 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.127950 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qxgn4" event={"ID":"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963","Type":"ContainerStarted","Data":"bceb9993c9755997006de0a03c6340366fd67adb270847c52b3aa3441cd9c408"} Jun 10 12:48:08.580251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.580197 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:08.580435 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.580300 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:08.580435 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:08.580383 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:08.580531 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:08.580491 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs podName:19924bce-75e7-45a1-8222-5f6b693f9dc4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:10.580470078 +0000 UTC m=+5.132994855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs") pod "network-metrics-daemon-pgwrf" (UID: "19924bce-75e7-45a1-8222-5f6b693f9dc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:08.580531 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:08.580421 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:08.580656 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:08.580575 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret podName:340d0d25-8681-4a5e-bfbe-28f439bbfd89 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:10.58055076 +0000 UTC m=+5.133075532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret") pod "global-pull-secret-syncer-gtzj7" (UID: "340d0d25-8681-4a5e-bfbe-28f439bbfd89") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:08.637776 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.637544 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:48:08.682088 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.681395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvxw\" (UniqueName: \"kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw\") pod \"network-check-target-7qqkc\" (UID: \"fa74edf9-3c07-49b3-91a3-94d824bb0ea4\") " pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:08.682088 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:08.681583 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:48:08.682088 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:08.681605 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:48:08.682088 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:08.681618 2570 projected.go:196] Error preparing data for projected volume kube-api-access-xwvxw for pod openshift-network-diagnostics/network-check-target-7qqkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:08.682088 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:08.681676 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw podName:fa74edf9-3c07-49b3-91a3-94d824bb0ea4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:10.681657757 +0000 UTC m=+5.234182518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwvxw" (UniqueName: "kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw") pod "network-check-target-7qqkc" (UID: "fa74edf9-3c07-49b3-91a3-94d824bb0ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:08.923606 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.922233 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:43:06 +0000 UTC" deadline="2027-12-21 23:54:45.203694837 +0000 UTC" Jun 10 12:48:08.923606 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.922291 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13427h6m36.281408036s" Jun 10 12:48:08.923606 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.922459 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:08.923606 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:08.922572 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:08.923606 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:08.922985 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:08.923606 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:08.923093 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:09.925870 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:09.925832 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:09.926447 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:09.925969 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:10.597812 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:10.597761 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:10.598004 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:10.597843 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:10.598004 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:10.597978 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:10.598135 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:10.598028 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret podName:340d0d25-8681-4a5e-bfbe-28f439bbfd89 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:14.59801514 +0000 UTC m=+9.150539903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret") pod "global-pull-secret-syncer-gtzj7" (UID: "340d0d25-8681-4a5e-bfbe-28f439bbfd89") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:10.598135 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:10.598072 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:10.598135 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:10.598094 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs podName:19924bce-75e7-45a1-8222-5f6b693f9dc4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:14.598086986 +0000 UTC m=+9.150611747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs") pod "network-metrics-daemon-pgwrf" (UID: "19924bce-75e7-45a1-8222-5f6b693f9dc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:10.698982 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:10.698947 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvxw\" (UniqueName: \"kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw\") pod \"network-check-target-7qqkc\" (UID: \"fa74edf9-3c07-49b3-91a3-94d824bb0ea4\") " pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:10.699393 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:10.699248 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:48:10.699393 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:10.699271 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:48:10.699393 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:10.699283 2570 projected.go:196] Error preparing data for projected volume kube-api-access-xwvxw for pod openshift-network-diagnostics/network-check-target-7qqkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:10.699618 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:10.699431 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw podName:fa74edf9-3c07-49b3-91a3-94d824bb0ea4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:14.699401989 +0000 UTC m=+9.251926750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwvxw" (UniqueName: "kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw") pod "network-check-target-7qqkc" (UID: "fa74edf9-3c07-49b3-91a3-94d824bb0ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:10.922528 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:10.922453 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:10.922528 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:10.922499 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:10.922730 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:10.922620 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:10.922800 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:10.922754 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:11.927130 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:11.927097 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:11.927567 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:11.927226 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:12.922961 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:12.922794 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:12.922961 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:12.922847 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:12.923902 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:12.923661 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:12.923902 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:12.923868 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:13.922826 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:13.922786 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:13.923291 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:13.922916 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:14.635522 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:14.634914 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:14.635522 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:14.635000 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:14.635522 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:14.635117 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:14.635522 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:14.635179 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret podName:340d0d25-8681-4a5e-bfbe-28f439bbfd89 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:22.635160763 +0000 UTC m=+17.187685540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret") pod "global-pull-secret-syncer-gtzj7" (UID: "340d0d25-8681-4a5e-bfbe-28f439bbfd89") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:14.635870 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:14.635575 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:14.635870 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:14.635648 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs podName:19924bce-75e7-45a1-8222-5f6b693f9dc4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:22.635627003 +0000 UTC m=+17.188151764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs") pod "network-metrics-daemon-pgwrf" (UID: "19924bce-75e7-45a1-8222-5f6b693f9dc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:14.735409 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:14.735365 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvxw\" (UniqueName: \"kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw\") pod \"network-check-target-7qqkc\" (UID: \"fa74edf9-3c07-49b3-91a3-94d824bb0ea4\") " pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:14.735642 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:14.735614 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:48:14.735642 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:14.735644 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:48:14.735642 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:14.735658 2570 projected.go:196] Error preparing data for projected volume kube-api-access-xwvxw for pod openshift-network-diagnostics/network-check-target-7qqkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:14.735948 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:14.735720 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw podName:fa74edf9-3c07-49b3-91a3-94d824bb0ea4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:22.735701885 +0000 UTC m=+17.288226662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwvxw" (UniqueName: "kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw") pod "network-check-target-7qqkc" (UID: "fa74edf9-3c07-49b3-91a3-94d824bb0ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:14.923503 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:14.923420 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:14.923503 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:14.923466 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:14.923991 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:14.923555 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:14.923991 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:14.923687 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:15.923558 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:15.923527 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:15.924190 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:15.924159 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:16.923121 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:16.923044 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:16.923274 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:16.923043 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:16.923274 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:16.923198 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:16.923274 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:16.923244 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:17.922808 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:17.922766 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:17.923239 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:17.922919 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:18.923258 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:18.923169 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:18.923634 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:18.923176 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:18.923634 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:18.923296 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:18.923634 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:18.923394 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:19.922576 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:19.922542 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:19.922756 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:19.922668 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:20.923220 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:20.923190 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:20.923626 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:20.923231 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:20.923626 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:20.923311 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:20.923626 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:20.923467 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:21.923080 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:21.923041 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:21.923261 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:21.923184 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:22.699769 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:22.699731 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:22.699957 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:22.699787 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:22.699957 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:22.699936 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:22.700034 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:22.700018 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret podName:340d0d25-8681-4a5e-bfbe-28f439bbfd89 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:38.699995698 +0000 UTC m=+33.252520475 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret") pod "global-pull-secret-syncer-gtzj7" (UID: "340d0d25-8681-4a5e-bfbe-28f439bbfd89") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:22.700109 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:22.699939 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:22.700208 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:22.700163 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs podName:19924bce-75e7-45a1-8222-5f6b693f9dc4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:38.700143356 +0000 UTC m=+33.252668117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs") pod "network-metrics-daemon-pgwrf" (UID: "19924bce-75e7-45a1-8222-5f6b693f9dc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:22.800944 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:22.800906 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvxw\" (UniqueName: \"kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw\") pod \"network-check-target-7qqkc\" (UID: \"fa74edf9-3c07-49b3-91a3-94d824bb0ea4\") " pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:22.801117 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:22.801065 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:48:22.801117 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:22.801085 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:48:22.801117 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:22.801095 2570 projected.go:196] Error preparing data for projected volume kube-api-access-xwvxw for pod openshift-network-diagnostics/network-check-target-7qqkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:22.801278 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:22.801151 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw podName:fa74edf9-3c07-49b3-91a3-94d824bb0ea4 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:38.801136877 +0000 UTC m=+33.353661647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwvxw" (UniqueName: "kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw") pod "network-check-target-7qqkc" (UID: "fa74edf9-3c07-49b3-91a3-94d824bb0ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:22.923497 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:22.923412 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:22.923892 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:22.923526 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:22.923892 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:22.923590 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:22.923892 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:22.923706 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:23.923483 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:23.923447 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:23.923752 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:23.923578 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:24.922557 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:24.922521 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:24.922752 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:24.922533 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:24.922752 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:24.922639 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:24.922752 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:24.922732 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:25.923360 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:25.923153 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:25.923360 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:25.923276 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:26.922520 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:26.922470 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:26.922520 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:26.922512 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:26.922623 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:26.922601 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:26.922737 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:26.922712 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:27.178592 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:27.178544 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" event={"ID":"2800005ebd22734ffdd825485f6a9839","Type":"ContainerStarted","Data":"521e0d687545202a9960cda4210c62062268df4ba14d151cff7214b1e284c415"} Jun 10 12:48:27.195503 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:27.195452 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-135.ec2.internal" podStartSLOduration=21.195434574 podStartE2EDuration="21.195434574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:27.194789889 +0000 UTC m=+21.747314668" watchObservedRunningTime="2026-06-10 12:48:27.195434574 +0000 UTC m=+21.747959353" Jun 10 12:48:27.922965 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:27.922932 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:27.923130 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:27.923068 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:28.181558 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:28.181475 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qxgn4" event={"ID":"c09c65d1-5f9e-4ae3-9a4b-7451e4e56963","Type":"ContainerStarted","Data":"e4242fccc5efc777810702a877f4e349171792fc67747ec8462b8199efd9461f"} Jun 10 12:48:28.185597 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:28.185566 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" event={"ID":"dccf8486-5e33-4ec9-9242-de7a7c2b3347","Type":"ContainerStarted","Data":"c09b403edc4af666920cf64641539bc356c57124bb75b54a803d3e8ae08cc45e"} Jun 10 12:48:28.187014 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:28.186991 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7grq6" event={"ID":"f6aac403-a1ac-461d-bd7b-1eb5d0d1bfb1","Type":"ContainerStarted","Data":"bb54ca141bcec71446867edaddf0a6663a3164acedf64544d33b8cba06b85b8a"} Jun 10 12:48:28.201503 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:28.201435 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qxgn4" podStartSLOduration=2.223771121 podStartE2EDuration="22.201415414s" totalImagesPullingTime="19.977644293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:28.201090618 +0000 UTC m=+22.753615399" watchObservedRunningTime="2026-06-10 12:48:28.201415414 +0000 UTC m=+22.753940195" Jun 10 12:48:28.217695 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:28.217641 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7grq6" podStartSLOduration=2.499336324 podStartE2EDuration="22.217619394s" totalImagesPullingTime="19.71828307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:28.217412491 +0000 UTC m=+22.769937271" watchObservedRunningTime="2026-06-10 12:48:28.217619394 +0000 UTC m=+22.770144175" Jun 10 12:48:28.923159 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:28.922994 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:28.923329 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:28.923031 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:28.923329 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:28.923276 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:28.923329 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:28.923293 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:29.190063 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.190025 2570 generic.go:356] "Generic (PLEG): container finished" podID="40985e58-d53c-4ddb-8b4c-8bf40c46aa5d" containerID="d7c028ed23428bf0d3157e7df3495326916377d3e757b66c0f42a5b20f343824" exitCode=0 Jun 10 12:48:29.190729 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.190120 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" event={"ID":"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d","Type":"ContainerDied","Data":"d7c028ed23428bf0d3157e7df3495326916377d3e757b66c0f42a5b20f343824"} Jun 10 12:48:29.191585 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.191562 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ljx5n" event={"ID":"6c3fcff8-c57e-4735-9479-a68e74020927","Type":"ContainerStarted","Data":"2baee02e84302af64cdc8717d6b0942a3594446ce9502d46cfd56a9bd71699e8"} Jun 10 12:48:29.193083 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.193014 2570 generic.go:356] "Generic (PLEG): container finished" podID="27c5d6ad4d3c1d724ac8db31730eac59" containerID="08dc2e2db09cbf5fafccf31d1ac87b6059e896846e85883f0e460ff46d3c2243" exitCode=0 Jun 10 12:48:29.193083 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.193078 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" event={"ID":"27c5d6ad4d3c1d724ac8db31730eac59","Type":"ContainerDied","Data":"08dc2e2db09cbf5fafccf31d1ac87b6059e896846e85883f0e460ff46d3c2243"} Jun 10 12:48:29.194617 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.194592 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-76fjd" event={"ID":"727d6207-33ea-4612-8898-b513031d9bc4","Type":"ContainerStarted","Data":"6d8e293008fb4705188bd65fdb4bbc82bb8b93f0f016fd78764c52b1eb0614db"} Jun 10 12:48:29.196076 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.196054 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fr9j5" event={"ID":"860e986c-5515-492c-8b7a-fd084ede0dbf","Type":"ContainerStarted","Data":"5624dd8f03608bd88a7606464412eaa882b3ebbd5801d327808c99ae269b2b7e"} Jun 10 12:48:29.197315 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.197297 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" event={"ID":"f7c35aaf-e876-485a-8011-f55971ab3fb9","Type":"ContainerStarted","Data":"e116c08d23e9c656ff83c9eb5db10d7ad9e615e9c11544881dab46fdbadd34cb"} Jun 10 12:48:29.198527 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.198510 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ds6pq" event={"ID":"585f27a5-5755-4e14-868d-7b3f3c67d71d","Type":"ContainerStarted","Data":"dc06b769ee68407edd6f59d120414d461d2cced0e387c151d254d8ebd18c20b0"} Jun 10 12:48:29.200855 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.200832 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 12:48:29.201219 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.201196 2570 generic.go:356] "Generic (PLEG): container finished" podID="dccf8486-5e33-4ec9-9242-de7a7c2b3347" containerID="356b8bdf93de3a2deb1940fb02ecde80ed12aa6fcb988808206af26272311ea6" exitCode=1 Jun 10 12:48:29.201292 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.201258 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" event={"ID":"dccf8486-5e33-4ec9-9242-de7a7c2b3347","Type":"ContainerStarted","Data":"bb7ffcf10de65bffd996e6de3ede707355be6567a3e0d7d2147064d763bef999"} Jun 10 12:48:29.201343 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.201325 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" event={"ID":"dccf8486-5e33-4ec9-9242-de7a7c2b3347","Type":"ContainerStarted","Data":"65c45a8909d1cbe0b1a796a630568f7bcf4b690dd919aa93d006e423235036cc"} Jun 10 12:48:29.201386 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.201377 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" event={"ID":"dccf8486-5e33-4ec9-9242-de7a7c2b3347","Type":"ContainerStarted","Data":"f72d2d029a2ab947e496b68e1cee6428b3c47f813c86ea05329c825a0fd24099"} Jun 10 12:48:29.201461 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.201423 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" event={"ID":"dccf8486-5e33-4ec9-9242-de7a7c2b3347","Type":"ContainerStarted","Data":"fabac6bc3c7c15ed8f3d0cf8e52240414e8a3cfa7643cae2a6c98e615f750507"} Jun 10 12:48:29.201494 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.201473 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" event={"ID":"dccf8486-5e33-4ec9-9242-de7a7c2b3347","Type":"ContainerDied","Data":"356b8bdf93de3a2deb1940fb02ecde80ed12aa6fcb988808206af26272311ea6"} Jun 10 12:48:29.228016 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.227972 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fr9j5" podStartSLOduration=3.530766127 podStartE2EDuration="23.227958781s" totalImagesPullingTime="19.697192654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:29.227723573 +0000 UTC m=+23.780248351" watchObservedRunningTime="2026-06-10 12:48:29.227958781 +0000 UTC m=+23.780483560" Jun 10 12:48:29.245306 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.245259 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-76fjd" podStartSLOduration=3.540352758 podStartE2EDuration="23.245243368s" totalImagesPullingTime="19.70489061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:29.244834459 +0000 UTC m=+23.797359251" watchObservedRunningTime="2026-06-10 12:48:29.245243368 +0000 UTC m=+23.797768147" Jun 10 12:48:29.279677 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.279600 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ds6pq" podStartSLOduration=3.5589584800000003 podStartE2EDuration="23.279584401s" totalImagesPullingTime="19.720625921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:29.261927833 +0000 UTC m=+23.814452612" watchObservedRunningTime="2026-06-10 12:48:29.279584401 +0000 UTC m=+23.832109183" Jun 10 12:48:29.293605 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.293556 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ljx5n" podStartSLOduration=3.569736614 podStartE2EDuration="23.293540236s" totalImagesPullingTime="19.723803622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:29.293109182 +0000 UTC m=+23.845633963" watchObservedRunningTime="2026-06-10 12:48:29.293540236 +0000 UTC m=+23.846065015" Jun 10 12:48:29.418464 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.417836 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 12:48:29.917052 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.916941 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T12:48:29.418022643Z","UUID":"d0e830bf-3f66-41a9-80ef-8bba1702b0b9","Handler":null,"Name":"","Endpoint":""} Jun 10 12:48:29.919130 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.919104 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 12:48:29.919264 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.919154 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 12:48:29.922687 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:29.922662 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:29.923014 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:29.922800 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:30.205742 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:30.205653 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" event={"ID":"27c5d6ad4d3c1d724ac8db31730eac59","Type":"ContainerStarted","Data":"f426b77877abbdccf03acd4403de029919bb4cd728e34c8f67acbac904bb863f"} Jun 10 12:48:30.207744 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:30.207716 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" event={"ID":"f7c35aaf-e876-485a-8011-f55971ab3fb9","Type":"ContainerStarted","Data":"4d1c7550dd0be810d02f814893a1ae1046606664bf88b0acb9222df4faafa44c"} Jun 10 12:48:30.221957 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:30.221911 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-135.ec2.internal" podStartSLOduration=24.221895607 podStartE2EDuration="24.221895607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:30.221461328 +0000 UTC m=+24.773986109" watchObservedRunningTime="2026-06-10 12:48:30.221895607 +0000 UTC m=+24.774420385" Jun 10 12:48:30.923251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:30.923220 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:30.923501 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:30.923220 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:30.923501 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:30.923358 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:30.923501 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:30.923459 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:31.212096 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:31.212046 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" event={"ID":"f7c35aaf-e876-485a-8011-f55971ab3fb9","Type":"ContainerStarted","Data":"d56653e6dc2794d41225dcc07f4c9f0805960c7f992e1e17202c3be6014fcf72"} Jun 10 12:48:31.215525 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:31.215501 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 12:48:31.216350 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:31.215974 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" event={"ID":"dccf8486-5e33-4ec9-9242-de7a7c2b3347","Type":"ContainerStarted","Data":"fe072113e6451b0c2f892d05bedeecac8849feabb10500c5a2eb78a5a2f022a0"} Jun 10 12:48:31.922563 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:31.922521 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:31.922757 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:31.922650 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:32.923121 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:32.923082 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:32.923121 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:32.923115 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:32.923792 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:32.923214 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:32.923792 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:32.923373 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:33.805653 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:33.805396 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:33.806039 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:33.806017 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:33.821777 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:33.821726 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jq7" podStartSLOduration=6.040536551 podStartE2EDuration="27.821708268s" totalImagesPullingTime="21.781171717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:31.23802488 +0000 UTC m=+25.790549671" watchObservedRunningTime="2026-06-10 12:48:33.821708268 +0000 UTC m=+28.374233045" Jun 10 12:48:33.923012 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:33.922979 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:33.923172 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:33.923102 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:34.226688 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.226660 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 12:48:34.227038 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.227013 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" event={"ID":"dccf8486-5e33-4ec9-9242-de7a7c2b3347","Type":"ContainerStarted","Data":"95f1e45f50a7c843a2879ebb27e51d3569af5fe330ca9620b235c7e597c5e000"} Jun 10 12:48:34.227323 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.227301 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:34.227411 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.227376 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:34.227470 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.227422 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:34.227470 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.227451 2570 scope.go:117] "RemoveContainer" containerID="356b8bdf93de3a2deb1940fb02ecde80ed12aa6fcb988808206af26272311ea6" Jun 10 12:48:34.229323 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.229295 2570 generic.go:356] "Generic (PLEG): container finished" podID="40985e58-d53c-4ddb-8b4c-8bf40c46aa5d" containerID="68d0f5bc6303ab1c6e5acb33d860ac4be8e59fab13a46b7eacb72e88190be0bd" exitCode=0 Jun 10 12:48:34.229442 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.229399 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" event={"ID":"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d","Type":"ContainerDied","Data":"68d0f5bc6303ab1c6e5acb33d860ac4be8e59fab13a46b7eacb72e88190be0bd"} Jun 10 12:48:34.229679 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.229635 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:34.230238 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.230144 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ds6pq" Jun 10 12:48:34.244953 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.244929 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:34.246457 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.246439 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:48:34.922586 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.922554 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:34.922586 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:34.922583 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:34.922930 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:34.922685 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:34.922930 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:34.922837 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:35.206849 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:35.206691 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gtzj7"] Jun 10 12:48:35.210262 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:35.210230 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7qqkc"] Jun 10 12:48:35.210406 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:35.210361 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:35.210508 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:35.210473 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:35.211303 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:35.211276 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pgwrf"] Jun 10 12:48:35.236866 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:35.236846 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 12:48:35.237318 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:35.237286 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" event={"ID":"dccf8486-5e33-4ec9-9242-de7a7c2b3347","Type":"ContainerStarted","Data":"e516a07686fb36a331ca3d89708bead3ed11b25601c1fcad5eb7074062c65557"} Jun 10 12:48:35.239786 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:35.239769 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:35.239909 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:35.239802 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:35.239974 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:35.239942 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:35.240117 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:35.240090 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:35.268305 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:35.266773 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" podStartSLOduration=8.515145617 podStartE2EDuration="29.26675486s" totalImagesPullingTime="20.751609243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:35.266134024 +0000 UTC m=+29.818658803" watchObservedRunningTime="2026-06-10 12:48:35.26675486 +0000 UTC m=+29.819279640" Jun 10 12:48:36.243584 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:36.243548 2570 generic.go:356] "Generic (PLEG): container finished" podID="40985e58-d53c-4ddb-8b4c-8bf40c46aa5d" containerID="237e6c4a1b05240132c7d3c7dfde9af5674634a69f72b480be709e6aa7db749c" exitCode=0 Jun 10 12:48:36.244083 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:36.243644 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" event={"ID":"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d","Type":"ContainerDied","Data":"237e6c4a1b05240132c7d3c7dfde9af5674634a69f72b480be709e6aa7db749c"} Jun 10 12:48:36.922740 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:36.922702 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:36.922941 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:36.922702 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:36.922941 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:36.922805 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:36.922941 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:36.922817 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:36.922941 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:36.922904 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:36.923079 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:36.922978 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:38.251022 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:38.250985 2570 generic.go:356] "Generic (PLEG): container finished" podID="40985e58-d53c-4ddb-8b4c-8bf40c46aa5d" containerID="570016d427b9d2a7670874f64304c71cb83b9eb2864becb7779c1fc59d150f14" exitCode=0 Jun 10 12:48:38.251689 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:38.251055 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" event={"ID":"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d","Type":"ContainerDied","Data":"570016d427b9d2a7670874f64304c71cb83b9eb2864becb7779c1fc59d150f14"} Jun 10 12:48:38.721832 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:38.721796 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:38.722035 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:38.721858 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:38.722035 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.721969 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:38.722035 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.722015 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:38.722197 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.722047 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret podName:340d0d25-8681-4a5e-bfbe-28f439bbfd89 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:10.722024189 +0000 UTC m=+65.274548953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret") pod "global-pull-secret-syncer-gtzj7" (UID: "340d0d25-8681-4a5e-bfbe-28f439bbfd89") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:48:38.722197 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.722079 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs podName:19924bce-75e7-45a1-8222-5f6b693f9dc4 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:10.72206159 +0000 UTC m=+65.274586359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs") pod "network-metrics-daemon-pgwrf" (UID: "19924bce-75e7-45a1-8222-5f6b693f9dc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:48:38.823228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:38.823188 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvxw\" (UniqueName: \"kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw\") pod \"network-check-target-7qqkc\" (UID: \"fa74edf9-3c07-49b3-91a3-94d824bb0ea4\") " pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:38.823418 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.823345 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:48:38.823418 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.823368 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:48:38.823418 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.823383 2570 projected.go:196] Error preparing data for projected volume kube-api-access-xwvxw for pod openshift-network-diagnostics/network-check-target-7qqkc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:38.823552 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.823460 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw podName:fa74edf9-3c07-49b3-91a3-94d824bb0ea4 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:10.823444768 +0000 UTC m=+65.375969545 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xwvxw" (UniqueName: "kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw") pod "network-check-target-7qqkc" (UID: "fa74edf9-3c07-49b3-91a3-94d824bb0ea4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:48:38.922995 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:38.922962 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:38.923172 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:38.923005 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:38.923172 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.923087 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:38.923172 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:38.922969 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:38.923312 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.923187 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:38.923312 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:38.923285 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:40.922540 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:40.922361 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:40.922972 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:40.922362 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:40.922972 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:40.922630 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:48:40.922972 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:40.922734 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gtzj7" podUID="340d0d25-8681-4a5e-bfbe-28f439bbfd89" Jun 10 12:48:40.922972 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:40.922409 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:40.922972 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:40.922845 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7qqkc" podUID="fa74edf9-3c07-49b3-91a3-94d824bb0ea4" Jun 10 12:48:41.209598 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.209455 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:41.265730 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.265701 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-135.ec2.internal" event="NodeReady" Jun 10 12:48:41.265934 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.265851 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 12:48:41.318015 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.317983 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rbnpx"] Jun 10 12:48:41.319372 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.319343 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:41.323396 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.323371 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n69pg"] Jun 10 12:48:41.323523 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.323506 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rbnpx" Jun 10 12:48:41.325974 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.325954 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 12:48:41.326086 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.326070 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 12:48:41.326144 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.326106 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 12:48:41.326144 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.326116 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xqtln\"" Jun 10 12:48:41.326739 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.326717 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.328950 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.328920 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 12:48:41.328950 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.328922 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s86xl\"" Jun 10 12:48:41.329072 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.328953 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 12:48:41.335041 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.335001 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rbnpx"] Jun 10 12:48:41.335846 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.335822 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n69pg"] Jun 10 12:48:41.443614 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.443574 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fe937e4-af59-45df-bd54-dac3e7e7aa99-config-volume\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.443811 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.443624 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.443811 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.443654 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fe937e4-af59-45df-bd54-dac3e7e7aa99-tmp-dir\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.443811 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.443777 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lr6h\" (UniqueName: \"kubernetes.io/projected/7fe937e4-af59-45df-bd54-dac3e7e7aa99-kube-api-access-2lr6h\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.443967 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.443826 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54dacbb9-4aa6-4102-a051-6877ee64180b-cert\") pod \"ingress-canary-rbnpx\" (UID: \"54dacbb9-4aa6-4102-a051-6877ee64180b\") " pod="openshift-ingress-canary/ingress-canary-rbnpx" Jun 10 12:48:41.443967 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.443862 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xqx9\" (UniqueName: \"kubernetes.io/projected/54dacbb9-4aa6-4102-a051-6877ee64180b-kube-api-access-8xqx9\") pod \"ingress-canary-rbnpx\" (UID: \"54dacbb9-4aa6-4102-a051-6877ee64180b\") " pod="openshift-ingress-canary/ingress-canary-rbnpx" Jun 10 12:48:41.544968 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.544856 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54dacbb9-4aa6-4102-a051-6877ee64180b-cert\") pod \"ingress-canary-rbnpx\" (UID: \"54dacbb9-4aa6-4102-a051-6877ee64180b\") " pod="openshift-ingress-canary/ingress-canary-rbnpx" Jun 10 12:48:41.544968 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.544925 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xqx9\" (UniqueName: \"kubernetes.io/projected/54dacbb9-4aa6-4102-a051-6877ee64180b-kube-api-access-8xqx9\") pod \"ingress-canary-rbnpx\" (UID: \"54dacbb9-4aa6-4102-a051-6877ee64180b\") " pod="openshift-ingress-canary/ingress-canary-rbnpx" Jun 10 12:48:41.544968 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.544964 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fe937e4-af59-45df-bd54-dac3e7e7aa99-config-volume\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.545206 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.544987 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.545206 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.545008 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fe937e4-af59-45df-bd54-dac3e7e7aa99-tmp-dir\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.545206 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.545088 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lr6h\" (UniqueName: \"kubernetes.io/projected/7fe937e4-af59-45df-bd54-dac3e7e7aa99-kube-api-access-2lr6h\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.545206 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:41.545112 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:48:41.545206 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:41.545181 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls podName:7fe937e4-af59-45df-bd54-dac3e7e7aa99 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:42.045160797 +0000 UTC m=+36.597685572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls") pod "dns-default-n69pg" (UID: "7fe937e4-af59-45df-bd54-dac3e7e7aa99") : secret "dns-default-metrics-tls" not found Jun 10 12:48:41.545417 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.545394 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7fe937e4-af59-45df-bd54-dac3e7e7aa99-tmp-dir\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.545615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.545591 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7fe937e4-af59-45df-bd54-dac3e7e7aa99-config-volume\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.550126 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.550100 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/54dacbb9-4aa6-4102-a051-6877ee64180b-cert\") pod \"ingress-canary-rbnpx\" (UID: \"54dacbb9-4aa6-4102-a051-6877ee64180b\") " pod="openshift-ingress-canary/ingress-canary-rbnpx" Jun 10 12:48:41.553707 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.553597 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xqx9\" (UniqueName: \"kubernetes.io/projected/54dacbb9-4aa6-4102-a051-6877ee64180b-kube-api-access-8xqx9\") pod \"ingress-canary-rbnpx\" (UID: \"54dacbb9-4aa6-4102-a051-6877ee64180b\") " pod="openshift-ingress-canary/ingress-canary-rbnpx" Jun 10 12:48:41.553707 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.553637 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lr6h\" (UniqueName: \"kubernetes.io/projected/7fe937e4-af59-45df-bd54-dac3e7e7aa99-kube-api-access-2lr6h\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:41.636234 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.636200 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rbnpx" Jun 10 12:48:41.941922 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:41.941871 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:42.048211 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.048177 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:42.048386 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:42.048370 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:48:42.048476 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:42.048462 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls podName:7fe937e4-af59-45df-bd54-dac3e7e7aa99 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:43.04843641 +0000 UTC m=+37.600961188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls") pod "dns-default-n69pg" (UID: "7fe937e4-af59-45df-bd54-dac3e7e7aa99") : secret "dns-default-metrics-tls" not found Jun 10 12:48:42.178002 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.177977 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rbnpx"] Jun 10 12:48:42.181946 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:48:42.181922 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54dacbb9_4aa6_4102_a051_6877ee64180b.slice/crio-f4b2124d0d9604896940506105e2404372c080ec2f757b29e36616294fc66091 WatchSource:0}: Error finding container f4b2124d0d9604896940506105e2404372c080ec2f757b29e36616294fc66091: Status 404 returned error can't find the container with id f4b2124d0d9604896940506105e2404372c080ec2f757b29e36616294fc66091 Jun 10 12:48:42.263719 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.263689 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" event={"ID":"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d","Type":"ContainerStarted","Data":"70c57209c1a6adef7575b099dcd733223452807694ff33f99bee66bdfc09c0b6"} Jun 10 12:48:42.264827 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.264802 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rbnpx" event={"ID":"54dacbb9-4aa6-4102-a051-6877ee64180b","Type":"ContainerStarted","Data":"f4b2124d0d9604896940506105e2404372c080ec2f757b29e36616294fc66091"} Jun 10 12:48:42.312202 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.312177 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:42.392089 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.392052 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:42.922893 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.922841 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:48:42.923074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.922841 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:48:42.923074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.922974 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:48:42.926651 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.926502 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 12:48:42.926651 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.926530 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 12:48:42.926651 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.926540 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7d5dq\"" Jun 10 12:48:42.926651 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.926570 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g75kp\"" Jun 10 12:48:42.926651 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.926606 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 12:48:42.926651 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:42.926628 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 12:48:43.057089 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:43.057051 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:43.057532 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:43.057213 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:48:43.057532 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:43.057283 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls podName:7fe937e4-af59-45df-bd54-dac3e7e7aa99 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:45.057263181 +0000 UTC m=+39.609787961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls") pod "dns-default-n69pg" (UID: "7fe937e4-af59-45df-bd54-dac3e7e7aa99") : secret "dns-default-metrics-tls" not found Jun 10 12:48:43.146944 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:43.146909 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:43.247623 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:43.247540 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:43.271234 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:43.271194 2570 generic.go:356] "Generic (PLEG): container finished" podID="40985e58-d53c-4ddb-8b4c-8bf40c46aa5d" containerID="70c57209c1a6adef7575b099dcd733223452807694ff33f99bee66bdfc09c0b6" exitCode=0 Jun 10 12:48:43.271436 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:43.271254 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" event={"ID":"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d","Type":"ContainerDied","Data":"70c57209c1a6adef7575b099dcd733223452807694ff33f99bee66bdfc09c0b6"} Jun 10 12:48:43.305654 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:43.305618 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:43.967018 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:43.966984 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:44.027902 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:44.027850 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:44.277279 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:44.277239 2570 generic.go:356] "Generic (PLEG): container finished" podID="40985e58-d53c-4ddb-8b4c-8bf40c46aa5d" containerID="006164a60fec1f022200e84a321d95e9e2ca2b0a9f66bce404d5cca8a179899e" exitCode=0 Jun 10 12:48:44.277940 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:44.277315 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" event={"ID":"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d","Type":"ContainerDied","Data":"006164a60fec1f022200e84a321d95e9e2ca2b0a9f66bce404d5cca8a179899e"} Jun 10 12:48:44.278869 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:44.278842 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rbnpx" event={"ID":"54dacbb9-4aa6-4102-a051-6877ee64180b","Type":"ContainerStarted","Data":"a827de22ab34281ddf9270d0dd34d47c04b3e5dd2b356a00a482685fc0b0cc89"} Jun 10 12:48:44.317232 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:44.317174 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rbnpx" podStartSLOduration=1.359732073 podStartE2EDuration="3.317150646s" totalImagesPullingTime="1.957418573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:44.316008339 +0000 UTC m=+38.868533118" watchObservedRunningTime="2026-06-10 12:48:44.317150646 +0000 UTC m=+38.869675429" Jun 10 12:48:44.520676 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:44.520645 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:44.577854 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:44.577820 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:45.075228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:45.075137 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:45.075371 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:45.075299 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:48:45.075371 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:45.075365 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls podName:7fe937e4-af59-45df-bd54-dac3e7e7aa99 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:49.075351023 +0000 UTC m=+43.627875784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls") pod "dns-default-n69pg" (UID: "7fe937e4-af59-45df-bd54-dac3e7e7aa99") : secret "dns-default-metrics-tls" not found Jun 10 12:48:45.284666 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:45.284631 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" event={"ID":"40985e58-d53c-4ddb-8b4c-8bf40c46aa5d","Type":"ContainerStarted","Data":"f710d3c997b73227d9daa47ef3776cf350480c1c5e02e89138df4e2510d53c00"} Jun 10 12:48:45.310487 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:45.310394 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h6p7s" podStartSLOduration=9.685687394 podStartE2EDuration="39.310376026s" totalImagesPullingTime="29.624688632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:48:45.309132195 +0000 UTC m=+39.861656974" watchObservedRunningTime="2026-06-10 12:48:45.310376026 +0000 UTC m=+39.862900806" Jun 10 12:48:45.440717 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:45.440673 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:45.541313 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:45.541279 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:48:49.105062 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:49.105014 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:49.105460 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:49.105176 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:48:49.105460 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:49.105242 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls podName:7fe937e4-af59-45df-bd54-dac3e7e7aa99 nodeName:}" failed. No retries permitted until 2026-06-10 12:48:57.105225028 +0000 UTC m=+51.657749802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls") pod "dns-default-n69pg" (UID: "7fe937e4-af59-45df-bd54-dac3e7e7aa99") : secret "dns-default-metrics-tls" not found Jun 10 12:48:57.159117 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:48:57.159076 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:48:57.159634 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:57.159234 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:48:57.159634 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:48:57.159294 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls podName:7fe937e4-af59-45df-bd54-dac3e7e7aa99 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:13.159278976 +0000 UTC m=+67.711803737 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls") pod "dns-default-n69pg" (UID: "7fe937e4-af59-45df-bd54-dac3e7e7aa99") : secret "dns-default-metrics-tls" not found Jun 10 12:49:04.102149 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:04.102113 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:49:04.200714 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:04.200684 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:49:04.300678 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:04.300643 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:49:04.363669 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:04.363568 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:49:06.264267 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:06.264227 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2lkfl" Jun 10 12:49:06.395417 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:06.395382 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:49:06.495514 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:06.495478 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:49:10.750204 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.750170 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:49:10.750615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.750228 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:49:10.752930 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.752912 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 12:49:10.752995 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.752948 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 12:49:10.761074 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:49:10.761057 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:49:10.761123 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:49:10.761114 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs podName:19924bce-75e7-45a1-8222-5f6b693f9dc4 nodeName:}" failed. No retries permitted until 2026-06-10 12:50:14.761098779 +0000 UTC m=+129.313623537 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs") pod "network-metrics-daemon-pgwrf" (UID: "19924bce-75e7-45a1-8222-5f6b693f9dc4") : secret "metrics-daemon-secret" not found Jun 10 12:49:10.764121 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.764101 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/340d0d25-8681-4a5e-bfbe-28f439bbfd89-original-pull-secret\") pod \"global-pull-secret-syncer-gtzj7\" (UID: \"340d0d25-8681-4a5e-bfbe-28f439bbfd89\") " pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:49:10.843447 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.843410 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gtzj7" Jun 10 12:49:10.850901 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.850868 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwvxw\" (UniqueName: \"kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw\") pod \"network-check-target-7qqkc\" (UID: \"fa74edf9-3c07-49b3-91a3-94d824bb0ea4\") " pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:49:10.853522 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.853489 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 12:49:10.864272 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.864241 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 12:49:10.874797 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.874767 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwvxw\" (UniqueName: \"kubernetes.io/projected/fa74edf9-3c07-49b3-91a3-94d824bb0ea4-kube-api-access-xwvxw\") pod \"network-check-target-7qqkc\" (UID: \"fa74edf9-3c07-49b3-91a3-94d824bb0ea4\") " pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:49:10.965334 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:10.965300 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gtzj7"] Jun 10 12:49:10.968155 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:49:10.968130 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340d0d25_8681_4a5e_bfbe_28f439bbfd89.slice/crio-f595ef47012e12208016db6a2b79763ff2e872e8104629283733c83742f26663 WatchSource:0}: Error finding container f595ef47012e12208016db6a2b79763ff2e872e8104629283733c83742f26663: Status 404 returned error can't find the container with id f595ef47012e12208016db6a2b79763ff2e872e8104629283733c83742f26663 Jun 10 12:49:11.137872 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:11.137846 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g75kp\"" Jun 10 12:49:11.145984 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:11.145955 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:49:11.263314 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:11.263283 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7qqkc"] Jun 10 12:49:11.266041 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:49:11.266017 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa74edf9_3c07_49b3_91a3_94d824bb0ea4.slice/crio-b979e75e5c034029d95ee701f9c370a2913d10a4f64bb95e7e87a073576704f8 WatchSource:0}: Error finding container b979e75e5c034029d95ee701f9c370a2913d10a4f64bb95e7e87a073576704f8: Status 404 returned error can't find the container with id b979e75e5c034029d95ee701f9c370a2913d10a4f64bb95e7e87a073576704f8 Jun 10 12:49:11.353206 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:11.353163 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7qqkc" event={"ID":"fa74edf9-3c07-49b3-91a3-94d824bb0ea4","Type":"ContainerStarted","Data":"b979e75e5c034029d95ee701f9c370a2913d10a4f64bb95e7e87a073576704f8"} Jun 10 12:49:11.354618 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:11.354587 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gtzj7" event={"ID":"340d0d25-8681-4a5e-bfbe-28f439bbfd89","Type":"ContainerStarted","Data":"f595ef47012e12208016db6a2b79763ff2e872e8104629283733c83742f26663"} Jun 10 12:49:13.171447 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:13.171398 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:49:13.171952 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:49:13.171800 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:49:13.171952 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:49:13.171892 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls podName:7fe937e4-af59-45df-bd54-dac3e7e7aa99 nodeName:}" failed. No retries permitted until 2026-06-10 12:49:45.171850706 +0000 UTC m=+99.724375464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls") pod "dns-default-n69pg" (UID: "7fe937e4-af59-45df-bd54-dac3e7e7aa99") : secret "dns-default-metrics-tls" not found Jun 10 12:49:16.372100 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:16.372053 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7qqkc" event={"ID":"fa74edf9-3c07-49b3-91a3-94d824bb0ea4","Type":"ContainerStarted","Data":"c7244545d6ef2501bf28d95abbe534e3a2d9f23fd96b258e7be6556185d89fdb"} Jun 10 12:49:16.372590 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:16.372158 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:49:16.373539 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:16.373517 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gtzj7" event={"ID":"340d0d25-8681-4a5e-bfbe-28f439bbfd89","Type":"ContainerStarted","Data":"f55811efe496f2a4b358b967aaf8d3ea03da8d4dea97a2cfeb34fd7196a5e77c"} Jun 10 12:49:16.388492 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:16.388446 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7qqkc" podStartSLOduration=65.820896123 podStartE2EDuration="1m10.388432602s" totalImagesPullingTime="4.567536479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:16.388234598 +0000 UTC m=+70.940759378" watchObservedRunningTime="2026-06-10 12:49:16.388432602 +0000 UTC m=+70.940957380" Jun 10 12:49:16.404430 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:16.404387 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gtzj7" podStartSLOduration=65.535075471 podStartE2EDuration="1m10.404373131s" totalImagesPullingTime="4.86929766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:16.403870219 +0000 UTC m=+70.956394996" watchObservedRunningTime="2026-06-10 12:49:16.404373131 +0000 UTC m=+70.956897910" Jun 10 12:49:17.722137 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.722107 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz"] Jun 10 12:49:17.723866 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.723848 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" Jun 10 12:49:17.726257 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.726234 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 12:49:17.727291 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.727274 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 12:49:17.727377 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.727307 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 12:49:17.727377 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.727332 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 12:49:17.727472 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.727278 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qbfqg\"" Jun 10 12:49:17.734064 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.734041 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz"] Jun 10 12:49:17.806423 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.806386 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2723f7d-040e-4ce2-9ec1-9de32c88df1c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c99c56f6-jsrwz\" (UID: \"b2723f7d-040e-4ce2-9ec1-9de32c88df1c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" Jun 10 12:49:17.806591 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.806434 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdr7p\" (UniqueName: \"kubernetes.io/projected/b2723f7d-040e-4ce2-9ec1-9de32c88df1c-kube-api-access-hdr7p\") pod \"managed-serviceaccount-addon-agent-5c99c56f6-jsrwz\" (UID: \"b2723f7d-040e-4ce2-9ec1-9de32c88df1c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" Jun 10 12:49:17.906849 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.906814 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2723f7d-040e-4ce2-9ec1-9de32c88df1c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c99c56f6-jsrwz\" (UID: \"b2723f7d-040e-4ce2-9ec1-9de32c88df1c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" Jun 10 12:49:17.906963 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.906870 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdr7p\" (UniqueName: \"kubernetes.io/projected/b2723f7d-040e-4ce2-9ec1-9de32c88df1c-kube-api-access-hdr7p\") pod \"managed-serviceaccount-addon-agent-5c99c56f6-jsrwz\" (UID: \"b2723f7d-040e-4ce2-9ec1-9de32c88df1c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" Jun 10 12:49:17.909439 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.909413 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2723f7d-040e-4ce2-9ec1-9de32c88df1c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c99c56f6-jsrwz\" (UID: \"b2723f7d-040e-4ce2-9ec1-9de32c88df1c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" Jun 10 12:49:17.915582 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:17.915560 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdr7p\" (UniqueName: \"kubernetes.io/projected/b2723f7d-040e-4ce2-9ec1-9de32c88df1c-kube-api-access-hdr7p\") pod \"managed-serviceaccount-addon-agent-5c99c56f6-jsrwz\" (UID: \"b2723f7d-040e-4ce2-9ec1-9de32c88df1c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" Jun 10 12:49:18.045010 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:18.044923 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" Jun 10 12:49:18.161345 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:18.161315 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz"] Jun 10 12:49:18.164133 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:49:18.164088 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2723f7d_040e_4ce2_9ec1_9de32c88df1c.slice/crio-316e26ba1c4ea470151700a9736e0a51b426668bec51e31a0c541701479081af WatchSource:0}: Error finding container 316e26ba1c4ea470151700a9736e0a51b426668bec51e31a0c541701479081af: Status 404 returned error can't find the container with id 316e26ba1c4ea470151700a9736e0a51b426668bec51e31a0c541701479081af Jun 10 12:49:18.379236 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:18.379201 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" event={"ID":"b2723f7d-040e-4ce2-9ec1-9de32c88df1c","Type":"ContainerStarted","Data":"316e26ba1c4ea470151700a9736e0a51b426668bec51e31a0c541701479081af"} Jun 10 12:49:19.017400 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:19.017339 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:49:19.076620 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:19.076584 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:49:23.393495 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:23.393458 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" event={"ID":"b2723f7d-040e-4ce2-9ec1-9de32c88df1c","Type":"ContainerStarted","Data":"e5060f4a9b223a90dd456900f53f6bd25352dd6d71f976dc28114c93a38e314e"} Jun 10 12:49:23.408762 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:23.408710 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" podStartSLOduration=1.949426337 podStartE2EDuration="6.408696263s" totalImagesPullingTime="4.459269926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:49:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:49:23.408236048 +0000 UTC m=+77.960760820" watchObservedRunningTime="2026-06-10 12:49:23.408696263 +0000 UTC m=+77.961221041" Jun 10 12:49:45.188966 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:45.188918 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:49:45.189371 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:49:45.189072 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:49:45.189371 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:49:45.189158 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls podName:7fe937e4-af59-45df-bd54-dac3e7e7aa99 nodeName:}" failed. No retries permitted until 2026-06-10 12:50:49.189140814 +0000 UTC m=+163.741665576 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls") pod "dns-default-n69pg" (UID: "7fe937e4-af59-45df-bd54-dac3e7e7aa99") : secret "dns-default-metrics-tls" not found Jun 10 12:49:47.378674 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:47.378644 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7qqkc" Jun 10 12:49:50.131738 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:49:50.131700 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:50:14.778271 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:50:14.778238 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:50:14.778708 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:50:14.778344 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:50:14.778708 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:50:14.778405 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs podName:19924bce-75e7-45a1-8222-5f6b693f9dc4 nodeName:}" failed. No retries permitted until 2026-06-10 12:52:16.778390524 +0000 UTC m=+251.330915281 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs") pod "network-metrics-daemon-pgwrf" (UID: "19924bce-75e7-45a1-8222-5f6b693f9dc4") : secret "metrics-daemon-secret" not found Jun 10 12:50:44.342269 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:50:44.342227 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n69pg" podUID="7fe937e4-af59-45df-bd54-dac3e7e7aa99" Jun 10 12:50:44.590130 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:50:44.590101 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n69pg" Jun 10 12:50:45.948931 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:50:45.948901 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:50:49.210596 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:50:49.210560 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:50:49.210999 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:50:49.210684 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:50:49.210999 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:50:49.210736 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls podName:7fe937e4-af59-45df-bd54-dac3e7e7aa99 nodeName:}" failed. No retries permitted until 2026-06-10 12:52:51.21072174 +0000 UTC m=+285.763246498 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls") pod "dns-default-n69pg" (UID: "7fe937e4-af59-45df-bd54-dac3e7e7aa99") : secret "dns-default-metrics-tls" not found Jun 10 12:50:57.922666 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:50:57.922561 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:51:23.677781 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:51:23.677746 2570 generic.go:356] "Generic (PLEG): container finished" podID="b2723f7d-040e-4ce2-9ec1-9de32c88df1c" containerID="e5060f4a9b223a90dd456900f53f6bd25352dd6d71f976dc28114c93a38e314e" exitCode=255 Jun 10 12:51:23.678196 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:51:23.677809 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" event={"ID":"b2723f7d-040e-4ce2-9ec1-9de32c88df1c","Type":"ContainerDied","Data":"e5060f4a9b223a90dd456900f53f6bd25352dd6d71f976dc28114c93a38e314e"} Jun 10 12:51:23.683158 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:51:23.683143 2570 scope.go:117] "RemoveContainer" containerID="e5060f4a9b223a90dd456900f53f6bd25352dd6d71f976dc28114c93a38e314e" Jun 10 12:51:24.682676 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:51:24.682635 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c99c56f6-jsrwz" event={"ID":"b2723f7d-040e-4ce2-9ec1-9de32c88df1c","Type":"ContainerStarted","Data":"dec1714929104431d0b1de0f4a802e15e7673a907b4fa20e67ad3e83ac028d4c"} Jun 10 12:52:05.684849 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:05.684808 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:16.869907 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:16.869859 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:52:16.870386 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:16.870011 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:52:16.870386 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:16.870087 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs podName:19924bce-75e7-45a1-8222-5f6b693f9dc4 nodeName:}" failed. No retries permitted until 2026-06-10 12:54:18.870067124 +0000 UTC m=+373.422591894 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs") pod "network-metrics-daemon-pgwrf" (UID: "19924bce-75e7-45a1-8222-5f6b693f9dc4") : secret "metrics-daemon-secret" not found Jun 10 12:52:21.257230 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:21.257186 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:28.870451 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.870383 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b695996c5-pbht8"] Jun 10 12:52:28.873096 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.873081 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:28.878243 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.878204 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 12:52:28.878243 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.878211 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 12:52:28.878444 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.878299 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 12:52:28.879033 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.879012 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d85b9\"" Jun 10 12:52:28.886652 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.886633 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 12:52:28.891659 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.891640 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b695996c5-pbht8"] Jun 10 12:52:28.938324 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.938292 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x"] Jun 10 12:52:28.941049 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.941032 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x" Jun 10 12:52:28.943474 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.943445 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 12:52:28.943611 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.943584 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:52:28.943679 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.943660 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jd47j\"" Jun 10 12:52:28.946705 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.946683 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-trusted-ca\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:28.946825 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.946710 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-bound-sa-token\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:28.946825 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.946744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhq79\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-kube-api-access-hhq79\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:28.946825 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.946770 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bd1b4f1-d8c2-412f-bfee-f9234935526c-ca-trust-extracted\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:28.946825 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.946792 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-installation-pull-secrets\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:28.947063 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.946839 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-certificates\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:28.947063 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.946868 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:28.947063 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.947034 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-image-registry-private-configuration\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:28.948221 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.948203 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9vd8v"] Jun 10 12:52:28.950794 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.950777 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-xfw7w"] Jun 10 12:52:28.950947 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.950930 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:28.953502 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.953482 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x"] Jun 10 12:52:28.953602 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.953568 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:28.956510 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:28.956485 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"trusted-ca\" is forbidden: User \"system:node:ip-10-0-140-135.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-140-135.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" type="*v1.ConfigMap" Jun 10 12:52:28.956854 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.956836 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-rgggs\"" Jun 10 12:52:28.957212 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:28.957188 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-135.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-140-135.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 10 12:52:28.957492 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.957479 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 12:52:28.958101 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.958079 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 12:52:28.958101 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:28.958087 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-140-135.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-140-135.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" type="*v1.Secret" Jun 10 12:52:28.958305 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.958290 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-275nz\"" Jun 10 12:52:28.958700 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.958624 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 12:52:28.958700 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:28.958646 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-135.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-140-135.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 10 12:52:28.958839 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.958812 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 12:52:28.958943 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:28.958914 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"console-operator-config\" is forbidden: User \"system:node:ip-10-0-140-135.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-140-135.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" Jun 10 12:52:28.965484 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.965463 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 12:52:28.974949 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.974929 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-xfw7w"] Jun 10 12:52:28.976433 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:28.976411 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9vd8v"] Jun 10 12:52:29.047553 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047515 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-certificates\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.047553 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047555 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.047804 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047594 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-image-registry-private-configuration\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.047804 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047628 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c58c9f2-1625-49f8-8714-82d111c716f1-trusted-ca-bundle\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.047804 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047651 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ng7v\" (UniqueName: \"kubernetes.io/projected/8c58c9f2-1625-49f8-8714-82d111c716f1-kube-api-access-2ng7v\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.047804 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047679 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-bound-sa-token\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.047804 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxmm4\" (UniqueName: \"kubernetes.io/projected/60db72e9-5e73-4f71-8642-80d4851cc276-kube-api-access-gxmm4\") pod \"volume-data-source-validator-78dd696465-pld4x\" (UID: \"60db72e9-5e73-4f71-8642-80d4851cc276\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x" Jun 10 12:52:29.047804 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:29.047755 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:52:29.047804 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:29.047775 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b695996c5-pbht8: secret "image-registry-tls" not found Jun 10 12:52:29.047804 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047771 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhq79\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-kube-api-access-hhq79\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.047804 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047798 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c58c9f2-1625-49f8-8714-82d111c716f1-tmp\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:29.047830 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls podName:4bd1b4f1-d8c2-412f-bfee-f9234935526c nodeName:}" failed. No retries permitted until 2026-06-10 12:52:29.547810531 +0000 UTC m=+264.100335307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls") pod "image-registry-7b695996c5-pbht8" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c") : secret "image-registry-tls" not found Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047869 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c58c9f2-1625-49f8-8714-82d111c716f1-service-ca-bundle\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047918 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bd1b4f1-d8c2-412f-bfee-f9234935526c-ca-trust-extracted\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047944 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-installation-pull-secrets\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.047980 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5aa1127c-4c83-4083-a93b-31d638231dac-config\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.048023 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1127c-4c83-4083-a93b-31d638231dac-trusted-ca\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.048057 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c58c9f2-1625-49f8-8714-82d111c716f1-serving-cert\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.048093 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpjhk\" (UniqueName: \"kubernetes.io/projected/5aa1127c-4c83-4083-a93b-31d638231dac-kube-api-access-cpjhk\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.048201 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8c58c9f2-1625-49f8-8714-82d111c716f1-snapshots\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.048218 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-certificates\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.048218 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bd1b4f1-d8c2-412f-bfee-f9234935526c-ca-trust-extracted\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.048251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.048242 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-trusted-ca\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.048694 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.048302 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa1127c-4c83-4083-a93b-31d638231dac-serving-cert\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:29.049003 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.048986 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-trusted-ca\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.050039 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.050015 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-installation-pull-secrets\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.050143 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.050127 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-image-registry-private-configuration\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.056702 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.056682 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-bound-sa-token\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.056834 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.056818 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhq79\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-kube-api-access-hhq79\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.112131 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.112092 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:29.149358 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149294 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxmm4\" (UniqueName: \"kubernetes.io/projected/60db72e9-5e73-4f71-8642-80d4851cc276-kube-api-access-gxmm4\") pod \"volume-data-source-validator-78dd696465-pld4x\" (UID: \"60db72e9-5e73-4f71-8642-80d4851cc276\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x" Jun 10 12:52:29.149358 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149329 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c58c9f2-1625-49f8-8714-82d111c716f1-tmp\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.149358 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149347 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c58c9f2-1625-49f8-8714-82d111c716f1-service-ca-bundle\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.149569 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149363 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5aa1127c-4c83-4083-a93b-31d638231dac-config\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:29.149569 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149379 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1127c-4c83-4083-a93b-31d638231dac-trusted-ca\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:29.149569 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149393 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c58c9f2-1625-49f8-8714-82d111c716f1-serving-cert\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.149569 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149412 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjhk\" (UniqueName: \"kubernetes.io/projected/5aa1127c-4c83-4083-a93b-31d638231dac-kube-api-access-cpjhk\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:29.149569 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149452 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8c58c9f2-1625-49f8-8714-82d111c716f1-snapshots\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.149569 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149488 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa1127c-4c83-4083-a93b-31d638231dac-serving-cert\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:29.149569 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149552 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c58c9f2-1625-49f8-8714-82d111c716f1-trusted-ca-bundle\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.149859 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149576 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ng7v\" (UniqueName: \"kubernetes.io/projected/8c58c9f2-1625-49f8-8714-82d111c716f1-kube-api-access-2ng7v\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.149859 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.149753 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c58c9f2-1625-49f8-8714-82d111c716f1-tmp\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.150129 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.150109 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/8c58c9f2-1625-49f8-8714-82d111c716f1-snapshots\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.150178 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.150140 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c58c9f2-1625-49f8-8714-82d111c716f1-service-ca-bundle\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.150362 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.150345 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c58c9f2-1625-49f8-8714-82d111c716f1-trusted-ca-bundle\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.151752 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.151724 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c58c9f2-1625-49f8-8714-82d111c716f1-serving-cert\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.157766 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.157739 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxmm4\" (UniqueName: \"kubernetes.io/projected/60db72e9-5e73-4f71-8642-80d4851cc276-kube-api-access-gxmm4\") pod \"volume-data-source-validator-78dd696465-pld4x\" (UID: \"60db72e9-5e73-4f71-8642-80d4851cc276\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x" Jun 10 12:52:29.157963 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.157944 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ng7v\" (UniqueName: \"kubernetes.io/projected/8c58c9f2-1625-49f8-8714-82d111c716f1-kube-api-access-2ng7v\") pod \"insights-operator-896549976-xfw7w\" (UID: \"8c58c9f2-1625-49f8-8714-82d111c716f1\") " pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.174150 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.174128 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:29.249991 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.249956 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x" Jun 10 12:52:29.266766 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.266739 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-xfw7w" Jun 10 12:52:29.378689 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.378665 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x"] Jun 10 12:52:29.381053 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:52:29.381028 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60db72e9_5e73_4f71_8642_80d4851cc276.slice/crio-e57b359bda4a3b80a6f26c711a42646c70d28dce7667ffc04a1dc7cf125513ea WatchSource:0}: Error finding container e57b359bda4a3b80a6f26c711a42646c70d28dce7667ffc04a1dc7cf125513ea: Status 404 returned error can't find the container with id e57b359bda4a3b80a6f26c711a42646c70d28dce7667ffc04a1dc7cf125513ea Jun 10 12:52:29.396368 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.396338 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-xfw7w"] Jun 10 12:52:29.398798 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:52:29.398775 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c58c9f2_1625_49f8_8714_82d111c716f1.slice/crio-dc20ce3c5ea416a5718d0a29fd1a9e861067ffb44a3f3af64a86ff3499eefc6e WatchSource:0}: Error finding container dc20ce3c5ea416a5718d0a29fd1a9e861067ffb44a3f3af64a86ff3499eefc6e: Status 404 returned error can't find the container with id dc20ce3c5ea416a5718d0a29fd1a9e861067ffb44a3f3af64a86ff3499eefc6e Jun 10 12:52:29.552585 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.552553 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:29.552744 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:29.552690 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:52:29.552744 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:29.552708 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b695996c5-pbht8: secret "image-registry-tls" not found Jun 10 12:52:29.552826 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:29.552758 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls podName:4bd1b4f1-d8c2-412f-bfee-f9234935526c nodeName:}" failed. No retries permitted until 2026-06-10 12:52:30.552744372 +0000 UTC m=+265.105269130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls") pod "image-registry-7b695996c5-pbht8" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c") : secret "image-registry-tls" not found Jun 10 12:52:29.763244 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.763168 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 12:52:29.775049 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.775026 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 12:52:29.782284 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.782262 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5aa1127c-4c83-4083-a93b-31d638231dac-serving-cert\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:29.831026 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.830990 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 12:52:29.840803 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.840775 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5aa1127c-4c83-4083-a93b-31d638231dac-trusted-ca\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:29.875600 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.875565 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xfw7w" event={"ID":"8c58c9f2-1625-49f8-8714-82d111c716f1","Type":"ContainerStarted","Data":"dc20ce3c5ea416a5718d0a29fd1a9e861067ffb44a3f3af64a86ff3499eefc6e"} Jun 10 12:52:29.876941 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:29.876907 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x" event={"ID":"60db72e9-5e73-4f71-8642-80d4851cc276","Type":"ContainerStarted","Data":"e57b359bda4a3b80a6f26c711a42646c70d28dce7667ffc04a1dc7cf125513ea"} Jun 10 12:52:30.078582 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:30.078510 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:52:30.089527 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:30.089504 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpjhk\" (UniqueName: \"kubernetes.io/projected/5aa1127c-4c83-4083-a93b-31d638231dac-kube-api-access-cpjhk\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:30.150258 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:30.150226 2570 configmap.go:193] Couldn't get configMap openshift-console-operator/console-operator-config: failed to sync configmap cache: timed out waiting for the condition Jun 10 12:52:30.150409 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:30.150335 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5aa1127c-4c83-4083-a93b-31d638231dac-config podName:5aa1127c-4c83-4083-a93b-31d638231dac nodeName:}" failed. No retries permitted until 2026-06-10 12:52:30.650306878 +0000 UTC m=+265.202831654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/5aa1127c-4c83-4083-a93b-31d638231dac-config") pod "console-operator-668fdbf85c-9vd8v" (UID: "5aa1127c-4c83-4083-a93b-31d638231dac") : failed to sync configmap cache: timed out waiting for the condition Jun 10 12:52:30.244022 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:30.243985 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 12:52:30.562038 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:30.562002 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:30.562193 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:30.562151 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:52:30.562193 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:30.562170 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b695996c5-pbht8: secret "image-registry-tls" not found Jun 10 12:52:30.562288 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:30.562243 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls podName:4bd1b4f1-d8c2-412f-bfee-f9234935526c nodeName:}" failed. No retries permitted until 2026-06-10 12:52:32.562221809 +0000 UTC m=+267.114746571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls") pod "image-registry-7b695996c5-pbht8" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c") : secret "image-registry-tls" not found Jun 10 12:52:30.662799 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:30.662723 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5aa1127c-4c83-4083-a93b-31d638231dac-config\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:30.663320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:30.663281 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5aa1127c-4c83-4083-a93b-31d638231dac-config\") pod \"console-operator-668fdbf85c-9vd8v\" (UID: \"5aa1127c-4c83-4083-a93b-31d638231dac\") " pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:30.761486 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:30.761454 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:30.881892 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:30.881838 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x" event={"ID":"60db72e9-5e73-4f71-8642-80d4851cc276","Type":"ContainerStarted","Data":"73186dfaea14495431f7244773fdfce7034022a02f621687a676feaffcba71fe"} Jun 10 12:52:30.898995 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:30.898951 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-pld4x" podStartSLOduration=1.871279889 podStartE2EDuration="2.898936946s" totalImagesPullingTime="1.027657057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:52:30.898391197 +0000 UTC m=+265.450915976" watchObservedRunningTime="2026-06-10 12:52:30.898936946 +0000 UTC m=+265.451461723" Jun 10 12:52:30.984228 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:30.984144 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:31.045226 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:31.045199 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:31.101208 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:31.101184 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-9vd8v"] Jun 10 12:52:31.104849 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:52:31.104818 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa1127c_4c83_4083_a93b_31d638231dac.slice/crio-914e8706e6ef8870a1201d45188f73feb382573976438cc9059294eae9772b55 WatchSource:0}: Error finding container 914e8706e6ef8870a1201d45188f73feb382573976438cc9059294eae9772b55: Status 404 returned error can't find the container with id 914e8706e6ef8870a1201d45188f73feb382573976438cc9059294eae9772b55 Jun 10 12:52:31.886572 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:31.886524 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" event={"ID":"5aa1127c-4c83-4083-a93b-31d638231dac","Type":"ContainerStarted","Data":"914e8706e6ef8870a1201d45188f73feb382573976438cc9059294eae9772b55"} Jun 10 12:52:31.888223 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:31.888196 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xfw7w" event={"ID":"8c58c9f2-1625-49f8-8714-82d111c716f1","Type":"ContainerStarted","Data":"a4081a118cb3055087ac47dbc8adeff1154c3e7968ac069fc1152da222906821"} Jun 10 12:52:31.910604 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:31.910548 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-xfw7w" podStartSLOduration=2.274039213 podStartE2EDuration="3.910531017s" totalImagesPullingTime="1.636491804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:52:31.910142425 +0000 UTC m=+266.462667204" watchObservedRunningTime="2026-06-10 12:52:31.910531017 +0000 UTC m=+266.463055777" Jun 10 12:52:32.579573 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:32.579535 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:32.579746 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:32.579714 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:52:32.579746 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:32.579735 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b695996c5-pbht8: secret "image-registry-tls" not found Jun 10 12:52:32.579867 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:32.579805 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls podName:4bd1b4f1-d8c2-412f-bfee-f9234935526c nodeName:}" failed. No retries permitted until 2026-06-10 12:52:36.579784149 +0000 UTC m=+271.132308909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls") pod "image-registry-7b695996c5-pbht8" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c") : secret "image-registry-tls" not found Jun 10 12:52:32.830270 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:32.830188 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:32.849425 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:32.849393 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh"] Jun 10 12:52:32.854023 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:32.854000 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh" Jun 10 12:52:32.856192 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:32.856134 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 12:52:32.857123 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:32.857057 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 12:52:32.857123 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:32.857092 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mr2qm\"" Jun 10 12:52:32.862463 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:32.862407 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh"] Jun 10 12:52:32.924439 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:32.924404 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:32.983286 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:32.983255 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbld\" (UniqueName: \"kubernetes.io/projected/9de970a5-e924-455f-ab16-592759956f53-kube-api-access-zsbld\") pod \"migrator-955ffdf5f-sv5jh\" (UID: \"9de970a5-e924-455f-ab16-592759956f53\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh" Jun 10 12:52:33.045231 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.045194 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:33.084019 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.083965 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbld\" (UniqueName: \"kubernetes.io/projected/9de970a5-e924-455f-ab16-592759956f53-kube-api-access-zsbld\") pod \"migrator-955ffdf5f-sv5jh\" (UID: \"9de970a5-e924-455f-ab16-592759956f53\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh" Jun 10 12:52:33.092147 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.092126 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbld\" (UniqueName: \"kubernetes.io/projected/9de970a5-e924-455f-ab16-592759956f53-kube-api-access-zsbld\") pod \"migrator-955ffdf5f-sv5jh\" (UID: \"9de970a5-e924-455f-ab16-592759956f53\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh" Jun 10 12:52:33.124235 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.124208 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:33.165048 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.165019 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh" Jun 10 12:52:33.284535 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.284509 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh"] Jun 10 12:52:33.287276 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:52:33.287247 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de970a5_e924_455f_ab16_592759956f53.slice/crio-d139eb6a99ffa143601d701fbb5182115e6f5a73b2157eca53c61fd1cfd80281 WatchSource:0}: Error finding container d139eb6a99ffa143601d701fbb5182115e6f5a73b2157eca53c61fd1cfd80281: Status 404 returned error can't find the container with id d139eb6a99ffa143601d701fbb5182115e6f5a73b2157eca53c61fd1cfd80281 Jun 10 12:52:33.541711 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.541628 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:33.644441 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.644417 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:33.897596 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.897567 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/0.log" Jun 10 12:52:33.897771 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.897608 2570 generic.go:356] "Generic (PLEG): container finished" podID="5aa1127c-4c83-4083-a93b-31d638231dac" containerID="5633cd549382801e2eca2c473eeaf7ecfcfd0718aea21104030548a4e3a72500" exitCode=255 Jun 10 12:52:33.897771 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.897700 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" event={"ID":"5aa1127c-4c83-4083-a93b-31d638231dac","Type":"ContainerDied","Data":"5633cd549382801e2eca2c473eeaf7ecfcfd0718aea21104030548a4e3a72500"} Jun 10 12:52:33.897938 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.897915 2570 scope.go:117] "RemoveContainer" containerID="5633cd549382801e2eca2c473eeaf7ecfcfd0718aea21104030548a4e3a72500" Jun 10 12:52:33.898967 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:33.898941 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh" event={"ID":"9de970a5-e924-455f-ab16-592759956f53","Type":"ContainerStarted","Data":"d139eb6a99ffa143601d701fbb5182115e6f5a73b2157eca53c61fd1cfd80281"} Jun 10 12:52:34.902956 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:34.902931 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 12:52:34.903283 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:34.903270 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/0.log" Jun 10 12:52:34.903340 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:34.903303 2570 generic.go:356] "Generic (PLEG): container finished" podID="5aa1127c-4c83-4083-a93b-31d638231dac" containerID="b208ccddeb686d9bc44c291d9715c4ce64b36c2bd12fb2fac38632927aedfad6" exitCode=255 Jun 10 12:52:34.903414 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:34.903392 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" event={"ID":"5aa1127c-4c83-4083-a93b-31d638231dac","Type":"ContainerDied","Data":"b208ccddeb686d9bc44c291d9715c4ce64b36c2bd12fb2fac38632927aedfad6"} Jun 10 12:52:34.903472 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:34.903459 2570 scope.go:117] "RemoveContainer" containerID="5633cd549382801e2eca2c473eeaf7ecfcfd0718aea21104030548a4e3a72500" Jun 10 12:52:34.903660 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:34.903642 2570 scope.go:117] "RemoveContainer" containerID="b208ccddeb686d9bc44c291d9715c4ce64b36c2bd12fb2fac38632927aedfad6" Jun 10 12:52:34.903830 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:34.903811 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9vd8v_openshift-console-operator(5aa1127c-4c83-4083-a93b-31d638231dac)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" podUID="5aa1127c-4c83-4083-a93b-31d638231dac" Jun 10 12:52:34.905086 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:34.905064 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh" event={"ID":"9de970a5-e924-455f-ab16-592759956f53","Type":"ContainerStarted","Data":"e99ca0c4638c9422976054ad1c5429be6f4f57848b644774e8a27a609d2216d5"} Jun 10 12:52:34.905155 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:34.905110 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh" event={"ID":"9de970a5-e924-455f-ab16-592759956f53","Type":"ContainerStarted","Data":"37cfd6567c6ec29520eb3317eabcc99b63d0e78ec25fa0add30faf2d564be541"} Jun 10 12:52:34.938547 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:34.938371 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-sv5jh" podStartSLOduration=1.7826291410000001 podStartE2EDuration="2.938354741s" totalImagesPullingTime="1.1557256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:52:34.938353589 +0000 UTC m=+269.490878369" watchObservedRunningTime="2026-06-10 12:52:34.938354741 +0000 UTC m=+269.490879520" Jun 10 12:52:35.023550 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:35.023519 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:35.090708 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:35.090682 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:35.185703 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:35.185645 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:35.260435 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:35.260413 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:35.606773 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:35.606747 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fr9j5_860e986c-5515-492c-8b7a-fd084ede0dbf/dns-node-resolver/0.log" Jun 10 12:52:35.909615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:35.909539 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 12:52:35.909981 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:35.909845 2570 scope.go:117] "RemoveContainer" containerID="b208ccddeb686d9bc44c291d9715c4ce64b36c2bd12fb2fac38632927aedfad6" Jun 10 12:52:35.910024 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:35.910003 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9vd8v_openshift-console-operator(5aa1127c-4c83-4083-a93b-31d638231dac)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" podUID="5aa1127c-4c83-4083-a93b-31d638231dac" Jun 10 12:52:36.168387 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:36.168297 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:36.606114 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:36.606091 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-76fjd_727d6207-33ea-4612-8898-b513031d9bc4/node-ca/0.log" Jun 10 12:52:36.612423 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:36.612404 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:36.612514 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:36.612503 2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:52:36.612554 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:36.612518 2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b695996c5-pbht8: secret "image-registry-tls" not found Jun 10 12:52:36.612583 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:36.612576 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls podName:4bd1b4f1-d8c2-412f-bfee-f9234935526c nodeName:}" failed. No retries permitted until 2026-06-10 12:52:44.612562159 +0000 UTC m=+279.165086917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls") pod "image-registry-7b695996c5-pbht8" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c") : secret "image-registry-tls" not found Jun 10 12:52:37.151390 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:37.151362 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:37.342046 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:37.342014 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:37.443135 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:37.443053 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:37.577713 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:37.577684 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:37.616759 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:37.616733 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbnpx_54dacbb9-4aa6-4102-a051-6877ee64180b/serve-healthcheck-canary/0.log" Jun 10 12:52:37.659661 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:37.659630 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:37.852944 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:37.852914 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:38.007297 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:38.007272 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sv5jh_9de970a5-e924-455f-ab16-592759956f53/migrator/0.log" Jun 10 12:52:38.207245 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:38.207175 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sv5jh_9de970a5-e924-455f-ab16-592759956f53/graceful-termination/0.log" Jun 10 12:52:38.745347 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:38.745309 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:38.887346 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:38.887286 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:39.252397 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:39.252360 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:39.435568 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:39.435534 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:39.636172 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:39.636145 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:40.643821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:40.643795 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:40.761553 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:40.761525 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:40.761701 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:40.761583 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:40.761950 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:40.761938 2570 scope.go:117] "RemoveContainer" containerID="b208ccddeb686d9bc44c291d9715c4ce64b36c2bd12fb2fac38632927aedfad6" Jun 10 12:52:40.762138 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:40.762115 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-9vd8v_openshift-console-operator(5aa1127c-4c83-4083-a93b-31d638231dac)\"" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" podUID="5aa1127c-4c83-4083-a93b-31d638231dac" Jun 10 12:52:41.038815 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:41.038737 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:41.140342 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:41.140311 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:41.444792 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:41.444754 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:41.842866 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:41.842836 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:42.052342 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:42.052311 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:42.470799 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:42.470763 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:43.087084 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:43.087055 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:43.275001 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:43.274975 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:43.655507 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:43.655479 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:43.718815 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:43.718785 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:43.841017 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:43.840985 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:44.236455 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:44.236427 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:44.443466 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:44.443431 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:44.672803 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:44.672773 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:44.675126 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:44.675098 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls\") pod \"image-registry-7b695996c5-pbht8\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:44.781320 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:44.781294 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:44.906331 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:44.906302 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b695996c5-pbht8"] Jun 10 12:52:44.909542 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:52:44.909514 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd1b4f1_d8c2_412f_bfee_f9234935526c.slice/crio-37a62ca79686f3679eef8de58b7a17961dbc7542bacd64f2cd212e7b7032dcf5 WatchSource:0}: Error finding container 37a62ca79686f3679eef8de58b7a17961dbc7542bacd64f2cd212e7b7032dcf5: Status 404 returned error can't find the container with id 37a62ca79686f3679eef8de58b7a17961dbc7542bacd64f2cd212e7b7032dcf5 Jun 10 12:52:44.939542 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:44.939515 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" event={"ID":"4bd1b4f1-d8c2-412f-bfee-f9234935526c","Type":"ContainerStarted","Data":"37a62ca79686f3679eef8de58b7a17961dbc7542bacd64f2cd212e7b7032dcf5"} Jun 10 12:52:45.041691 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:45.041632 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:45.436562 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:45.436529 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:45.637134 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:45.637103 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:45.892766 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:45.892735 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:45.943315 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:45.943287 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" event={"ID":"4bd1b4f1-d8c2-412f-bfee-f9234935526c","Type":"ContainerStarted","Data":"c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581"} Jun 10 12:52:45.943460 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:45.943368 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:52:45.964124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:45.963982 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" podStartSLOduration=17.963967739 podStartE2EDuration="17.963967739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:52:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:52:45.963688825 +0000 UTC m=+280.516213603" watchObservedRunningTime="2026-06-10 12:52:45.963967739 +0000 UTC m=+280.516492519" Jun 10 12:52:46.037662 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:46.037635 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:46.437445 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:46.437415 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:46.849352 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:46.849318 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:47.326303 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:47.326222 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:47.429164 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:47.429137 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:47.526132 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:47.526106 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:47.591514 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:52:47.591487 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n69pg" podUID="7fe937e4-af59-45df-bd54-dac3e7e7aa99" Jun 10 12:52:47.635706 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:47.635679 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:47.841800 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:47.841729 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:47.948562 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:47.948539 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n69pg" Jun 10 12:52:48.242966 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:48.242892 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:51.221231 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:51.221188 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:52:51.223523 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:51.223498 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7fe937e4-af59-45df-bd54-dac3e7e7aa99-metrics-tls\") pod \"dns-default-n69pg\" (UID: \"7fe937e4-af59-45df-bd54-dac3e7e7aa99\") " pod="openshift-dns/dns-default-n69pg" Jun 10 12:52:51.252259 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:51.252233 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s86xl\"" Jun 10 12:52:51.260416 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:51.260400 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n69pg" Jun 10 12:52:51.387573 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:51.387543 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n69pg"] Jun 10 12:52:51.390076 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:52:51.390048 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe937e4_af59_45df_bd54_dac3e7e7aa99.slice/crio-58c3ca8b94d5de43c5a2d6aeead5597e578b7d80415f479c29eb915a8db0df67 WatchSource:0}: Error finding container 58c3ca8b94d5de43c5a2d6aeead5597e578b7d80415f479c29eb915a8db0df67: Status 404 returned error can't find the container with id 58c3ca8b94d5de43c5a2d6aeead5597e578b7d80415f479c29eb915a8db0df67 Jun 10 12:52:51.963374 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:51.963342 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n69pg" event={"ID":"7fe937e4-af59-45df-bd54-dac3e7e7aa99","Type":"ContainerStarted","Data":"58c3ca8b94d5de43c5a2d6aeead5597e578b7d80415f479c29eb915a8db0df67"} Jun 10 12:52:52.967580 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:52.967548 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n69pg" event={"ID":"7fe937e4-af59-45df-bd54-dac3e7e7aa99","Type":"ContainerStarted","Data":"f92fcb2261ce916e3785a38f4e1129865a77d0698726745da7b67471e6100e63"} Jun 10 12:52:52.967945 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:52.967599 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n69pg" event={"ID":"7fe937e4-af59-45df-bd54-dac3e7e7aa99","Type":"ContainerStarted","Data":"4d1bc27a57000699fee24916209737c5ee69164208fd2f97409f9875e2d4987d"} Jun 10 12:52:52.967945 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:52.967671 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n69pg" Jun 10 12:52:52.989435 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:52.989393 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n69pg" podStartSLOduration=250.610624836 podStartE2EDuration="4m11.989378523s" totalImagesPullingTime="1.378753687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:52:52.987787179 +0000 UTC m=+287.540311958" watchObservedRunningTime="2026-06-10 12:52:52.989378523 +0000 UTC m=+287.541903362" Jun 10 12:52:54.923298 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:54.923256 2570 scope.go:117] "RemoveContainer" containerID="b208ccddeb686d9bc44c291d9715c4ce64b36c2bd12fb2fac38632927aedfad6" Jun 10 12:52:54.975017 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:54.974999 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 12:52:54.975127 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:54.975061 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" event={"ID":"5aa1127c-4c83-4083-a93b-31d638231dac","Type":"ContainerStarted","Data":"5abca54547af03fe658e9e9e5baf356491014a25845d581e703a7c127701da17"} Jun 10 12:52:55.127174 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.127139 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xcw6s"] Jun 10 12:52:55.130199 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.130178 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.134238 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.134201 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 12:52:55.134238 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.134212 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 12:52:55.134238 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.134209 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9c2ln\"" Jun 10 12:52:55.135530 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.135508 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b695996c5-pbht8"] Jun 10 12:52:55.146414 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.146395 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/756784a5-2d72-4345-925c-d7dfa2f2fc71-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.146503 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.146428 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knjqs\" (UniqueName: \"kubernetes.io/projected/756784a5-2d72-4345-925c-d7dfa2f2fc71-kube-api-access-knjqs\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.146503 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.146471 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/756784a5-2d72-4345-925c-d7dfa2f2fc71-crio-socket\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.146568 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.146548 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/756784a5-2d72-4345-925c-d7dfa2f2fc71-data-volume\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.146624 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.146608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/756784a5-2d72-4345-925c-d7dfa2f2fc71-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.154747 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.154726 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xcw6s"] Jun 10 12:52:55.160690 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.160668 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv"] Jun 10 12:52:55.163694 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.163679 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv" Jun 10 12:52:55.167058 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.167036 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 12:52:55.167159 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.167080 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-8knz4\"" Jun 10 12:52:55.176903 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.176840 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv"] Jun 10 12:52:55.194140 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.194118 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78b6d5dcd4-twlsm"] Jun 10 12:52:55.196893 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.196861 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.211540 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.211521 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b6d5dcd4-twlsm"] Jun 10 12:52:55.247675 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.247652 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knjqs\" (UniqueName: \"kubernetes.io/projected/756784a5-2d72-4345-925c-d7dfa2f2fc71-kube-api-access-knjqs\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.247807 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.247692 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1e5b8bf1-65c5-41e5-88f1-8383bd602665-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-htbxv\" (UID: \"1e5b8bf1-65c5-41e5-88f1-8383bd602665\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv" Jun 10 12:52:55.247807 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.247740 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/756784a5-2d72-4345-925c-d7dfa2f2fc71-crio-socket\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.247807 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.247789 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/756784a5-2d72-4345-925c-d7dfa2f2fc71-data-volume\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.248000 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.247845 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/756784a5-2d72-4345-925c-d7dfa2f2fc71-crio-socket\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.248000 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.247845 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/756784a5-2d72-4345-925c-d7dfa2f2fc71-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.248000 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.247927 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/756784a5-2d72-4345-925c-d7dfa2f2fc71-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.248142 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.248087 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/756784a5-2d72-4345-925c-d7dfa2f2fc71-data-volume\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.248371 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.248344 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/756784a5-2d72-4345-925c-d7dfa2f2fc71-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.250075 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.250051 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/756784a5-2d72-4345-925c-d7dfa2f2fc71-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.258470 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.258450 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-knjqs\" (UniqueName: \"kubernetes.io/projected/756784a5-2d72-4345-925c-d7dfa2f2fc71-kube-api-access-knjqs\") pod \"insights-runtime-extractor-xcw6s\" (UID: \"756784a5-2d72-4345-925c-d7dfa2f2fc71\") " pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.304929 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.304901 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:55.349114 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.349090 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f67f4d23-9bd7-424d-85b6-9745a74d2d88-trusted-ca\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.349212 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.349118 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f67f4d23-9bd7-424d-85b6-9745a74d2d88-registry-tls\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.349212 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.349141 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f67f4d23-9bd7-424d-85b6-9745a74d2d88-registry-certificates\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.349212 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.349158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcb8k\" (UniqueName: \"kubernetes.io/projected/f67f4d23-9bd7-424d-85b6-9745a74d2d88-kube-api-access-kcb8k\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.349314 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.349240 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f67f4d23-9bd7-424d-85b6-9745a74d2d88-ca-trust-extracted\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.349314 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.349289 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f67f4d23-9bd7-424d-85b6-9745a74d2d88-image-registry-private-configuration\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.349314 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.349309 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f67f4d23-9bd7-424d-85b6-9745a74d2d88-bound-sa-token\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.349401 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.349344 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1e5b8bf1-65c5-41e5-88f1-8383bd602665-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-htbxv\" (UID: \"1e5b8bf1-65c5-41e5-88f1-8383bd602665\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv" Jun 10 12:52:55.349433 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.349411 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f67f4d23-9bd7-424d-85b6-9745a74d2d88-installation-pull-secrets\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.351393 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.351373 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1e5b8bf1-65c5-41e5-88f1-8383bd602665-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-htbxv\" (UID: \"1e5b8bf1-65c5-41e5-88f1-8383bd602665\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv" Jun 10 12:52:55.401281 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.401256 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:55.439827 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.439777 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xcw6s" Jun 10 12:52:55.451821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.450198 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f67f4d23-9bd7-424d-85b6-9745a74d2d88-registry-tls\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.451821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.450248 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f67f4d23-9bd7-424d-85b6-9745a74d2d88-registry-certificates\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.451821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.450273 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcb8k\" (UniqueName: \"kubernetes.io/projected/f67f4d23-9bd7-424d-85b6-9745a74d2d88-kube-api-access-kcb8k\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.451821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.450308 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f67f4d23-9bd7-424d-85b6-9745a74d2d88-ca-trust-extracted\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.451821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.450346 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f67f4d23-9bd7-424d-85b6-9745a74d2d88-image-registry-private-configuration\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.451821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.450374 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f67f4d23-9bd7-424d-85b6-9745a74d2d88-bound-sa-token\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.451821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.450405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f67f4d23-9bd7-424d-85b6-9745a74d2d88-installation-pull-secrets\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.451821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.450450 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f67f4d23-9bd7-424d-85b6-9745a74d2d88-trusted-ca\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.451821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.451305 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f67f4d23-9bd7-424d-85b6-9745a74d2d88-trusted-ca\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.451821 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.451771 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f67f4d23-9bd7-424d-85b6-9745a74d2d88-ca-trust-extracted\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.452625 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.452056 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f67f4d23-9bd7-424d-85b6-9745a74d2d88-registry-certificates\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.453520 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.453487 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f67f4d23-9bd7-424d-85b6-9745a74d2d88-image-registry-private-configuration\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.453773 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.453757 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f67f4d23-9bd7-424d-85b6-9745a74d2d88-registry-tls\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.454129 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.454114 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f67f4d23-9bd7-424d-85b6-9745a74d2d88-installation-pull-secrets\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.458573 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.458552 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f67f4d23-9bd7-424d-85b6-9745a74d2d88-bound-sa-token\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.458648 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.458613 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcb8k\" (UniqueName: \"kubernetes.io/projected/f67f4d23-9bd7-424d-85b6-9745a74d2d88-kube-api-access-kcb8k\") pod \"image-registry-78b6d5dcd4-twlsm\" (UID: \"f67f4d23-9bd7-424d-85b6-9745a74d2d88\") " pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.472330 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.472309 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv" Jun 10 12:52:55.505898 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.505800 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.624004 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.623857 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xcw6s"] Jun 10 12:52:55.630233 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:52:55.630194 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756784a5_2d72_4345_925c_d7dfa2f2fc71.slice/crio-5ab7fce215d4f368dddef4f08aeb03cdf41894548a76bf5e50f4c28f01cc28a1 WatchSource:0}: Error finding container 5ab7fce215d4f368dddef4f08aeb03cdf41894548a76bf5e50f4c28f01cc28a1: Status 404 returned error can't find the container with id 5ab7fce215d4f368dddef4f08aeb03cdf41894548a76bf5e50f4c28f01cc28a1 Jun 10 12:52:55.664091 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.664032 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv"] Jun 10 12:52:55.682089 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.682067 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b6d5dcd4-twlsm"] Jun 10 12:52:55.683889 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:52:55.683853 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67f4d23_9bd7_424d_85b6_9745a74d2d88.slice/crio-68c20facdcf749985ca4525ac894871fbe0db45286df75c9e96c34ff006f1208 WatchSource:0}: Error finding container 68c20facdcf749985ca4525ac894871fbe0db45286df75c9e96c34ff006f1208: Status 404 returned error can't find the container with id 68c20facdcf749985ca4525ac894871fbe0db45286df75c9e96c34ff006f1208 Jun 10 12:52:55.883759 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.883728 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-fmdnf"] Jun 10 12:52:55.888395 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.888370 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-fmdnf" Jun 10 12:52:55.892062 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.892045 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gmrzc\"" Jun 10 12:52:55.892584 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.892561 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 12:52:55.894174 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.894147 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 12:52:55.914145 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.914122 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-fmdnf"] Jun 10 12:52:55.923488 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.923466 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:55.953715 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.953636 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnncv\" (UniqueName: \"kubernetes.io/projected/33576003-7473-4ff4-b870-562b12a0ea2d-kube-api-access-tnncv\") pod \"downloads-6657875f97-fmdnf\" (UID: \"33576003-7473-4ff4-b870-562b12a0ea2d\") " pod="openshift-console/downloads-6657875f97-fmdnf" Jun 10 12:52:55.979456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.979428 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" event={"ID":"f67f4d23-9bd7-424d-85b6-9745a74d2d88","Type":"ContainerStarted","Data":"1cd9f33b39c5e98523216e551b8ce70b5ed6e80734296f059fa5b2db036cc141"} Jun 10 12:52:55.979596 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.979476 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" event={"ID":"f67f4d23-9bd7-424d-85b6-9745a74d2d88","Type":"ContainerStarted","Data":"68c20facdcf749985ca4525ac894871fbe0db45286df75c9e96c34ff006f1208"} Jun 10 12:52:55.979596 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.979548 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:52:55.980668 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.980645 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv" event={"ID":"1e5b8bf1-65c5-41e5-88f1-8383bd602665","Type":"ContainerStarted","Data":"c7286994e2498eaca61b64ad550fba2c4c247a28410d4ccd0051efd1fee9e7d3"} Jun 10 12:52:55.982061 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.982035 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcw6s" event={"ID":"756784a5-2d72-4345-925c-d7dfa2f2fc71","Type":"ContainerStarted","Data":"605a285cdbd8c04d7ac75ff81468399f8d8536dbd7f6ce701cbea52a36a449f8"} Jun 10 12:52:55.982141 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.982091 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:55.982141 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.982108 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcw6s" event={"ID":"756784a5-2d72-4345-925c-d7dfa2f2fc71","Type":"ContainerStarted","Data":"5ab7fce215d4f368dddef4f08aeb03cdf41894548a76bf5e50f4c28f01cc28a1"} Jun 10 12:52:55.986842 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:55.986820 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" Jun 10 12:52:56.004010 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.003984 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:56.020843 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.020789 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-9vd8v" podStartSLOduration=26.048116905 podStartE2EDuration="28.020770371s" totalImagesPullingTime="1.972653466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:52:56.020103723 +0000 UTC m=+290.572628504" watchObservedRunningTime="2026-06-10 12:52:56.020770371 +0000 UTC m=+290.573295153" Jun 10 12:52:56.021323 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.021292 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" podStartSLOduration=1.021278628 podStartE2EDuration="1.021278628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:52:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:52:56.001998214 +0000 UTC m=+290.554522993" watchObservedRunningTime="2026-06-10 12:52:56.021278628 +0000 UTC m=+290.573803391" Jun 10 12:52:56.054842 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.054811 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnncv\" (UniqueName: \"kubernetes.io/projected/33576003-7473-4ff4-b870-562b12a0ea2d-kube-api-access-tnncv\") pod \"downloads-6657875f97-fmdnf\" (UID: \"33576003-7473-4ff4-b870-562b12a0ea2d\") " pod="openshift-console/downloads-6657875f97-fmdnf" Jun 10 12:52:56.066537 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.066482 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnncv\" (UniqueName: \"kubernetes.io/projected/33576003-7473-4ff4-b870-562b12a0ea2d-kube-api-access-tnncv\") pod \"downloads-6657875f97-fmdnf\" (UID: \"33576003-7473-4ff4-b870-562b12a0ea2d\") " pod="openshift-console/downloads-6657875f97-fmdnf" Jun 10 12:52:56.180173 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.180131 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:56.198208 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.198111 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-fmdnf" Jun 10 12:52:56.364398 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.364369 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-fmdnf"] Jun 10 12:52:56.366947 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:52:56.366920 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33576003_7473_4ff4_b870_562b12a0ea2d.slice/crio-b735fd03a83c4a957cb71604ba2c202c756afe9400dd3f6d369b0a94dd973cfc WatchSource:0}: Error finding container b735fd03a83c4a957cb71604ba2c202c756afe9400dd3f6d369b0a94dd973cfc: Status 404 returned error can't find the container with id b735fd03a83c4a957cb71604ba2c202c756afe9400dd3f6d369b0a94dd973cfc Jun 10 12:52:56.559006 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.558940 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:56.623939 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.623909 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:56.764110 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.764084 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:56.961923 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.961901 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:56.986867 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:56.986845 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-fmdnf" event={"ID":"33576003-7473-4ff4-b870-562b12a0ea2d","Type":"ContainerStarted","Data":"b735fd03a83c4a957cb71604ba2c202c756afe9400dd3f6d369b0a94dd973cfc"} Jun 10 12:52:57.061694 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:57.061666 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:57.304358 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:57.304277 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:57.404758 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:57.404720 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:57.561932 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:57.561839 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:57.802337 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:57.802301 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:57.969326 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:57.969275 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:57.994635 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:57.994201 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv" event={"ID":"1e5b8bf1-65c5-41e5-88f1-8383bd602665","Type":"ContainerStarted","Data":"abc0746743a7b5464332aa2f9b60a7a2b8bde5782531686f086dd8e0e19c5fd0"} Jun 10 12:52:57.994635 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:57.994547 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv" Jun 10 12:52:57.996859 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:57.996581 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcw6s" event={"ID":"756784a5-2d72-4345-925c-d7dfa2f2fc71","Type":"ContainerStarted","Data":"f9308f45dd49ad02551ffe5bab4adc3740a697d945e038f203eb480202b3109d"} Jun 10 12:52:58.000352 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:58.000332 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv" Jun 10 12:52:58.011666 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:58.011616 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-htbxv" podStartSLOduration=1.640242056 podStartE2EDuration="3.011598039s" totalImagesPullingTime="1.371355983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:52:58.01110607 +0000 UTC m=+292.563630852" watchObservedRunningTime="2026-06-10 12:52:58.011598039 +0000 UTC m=+292.564122821" Jun 10 12:52:58.574914 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:58.574862 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:58.682164 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:58.682057 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:58.769087 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:58.769051 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:52:59.001755 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:59.001657 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xcw6s" event={"ID":"756784a5-2d72-4345-925c-d7dfa2f2fc71","Type":"ContainerStarted","Data":"06dab7302610cc5f8ee58e8b5df1ef156603cc22034f25893440741382ae9ec3"} Jun 10 12:52:59.022021 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:52:59.021975 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xcw6s" podStartSLOduration=1.4723693500000001 podStartE2EDuration="4.021958996s" totalImagesPullingTime="2.549589646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:52:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:52:59.021129519 +0000 UTC m=+293.573654288" watchObservedRunningTime="2026-06-10 12:52:59.021958996 +0000 UTC m=+293.574483774" Jun 10 12:53:00.319124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:00.319081 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:00.923421 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:53:00.923380 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pgwrf" podUID="19924bce-75e7-45a1-8222-5f6b693f9dc4" Jun 10 12:53:02.714853 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:02.714821 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:02.840496 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:02.840463 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:02.972500 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:02.972416 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n69pg" Jun 10 12:53:05.141119 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:05.141084 2570 patch_prober.go:28] interesting pod/image-registry-7b695996c5-pbht8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:53:05.141567 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:05.141147 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" podUID="4bd1b4f1-d8c2-412f-bfee-f9234935526c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:53:05.869940 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:05.869869 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 12:53:05.870798 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:05.870754 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 12:53:05.875463 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:05.875383 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 12:53:05.876449 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:05.876425 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 12:53:05.885165 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:05.885149 2570 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 12:53:07.269543 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.269474 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:07.320588 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.320546 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w"] Jun 10 12:53:07.323663 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.323644 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.328076 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.328051 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 12:53:07.328256 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.328231 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 12:53:07.329419 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.329398 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ctvwp\"" Jun 10 12:53:07.329548 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.329460 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 12:53:07.329548 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.329460 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 12:53:07.329548 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.329399 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 12:53:07.329924 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.329906 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 12:53:07.337366 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.337345 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w"] Jun 10 12:53:07.351960 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.351935 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.352098 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.351972 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8vph\" (UniqueName: \"kubernetes.io/projected/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-api-access-n8vph\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.352098 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.352041 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.352098 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.352064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a024da6-fa8d-489e-ae88-191cb3ff2360-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.352098 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.352098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1a024da6-fa8d-489e-ae88-191cb3ff2360-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.352323 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.352169 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.370693 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.370662 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:07.453607 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.453573 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.453770 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.453619 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8vph\" (UniqueName: \"kubernetes.io/projected/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-api-access-n8vph\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.453770 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.453675 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.453770 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.453708 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a024da6-fa8d-489e-ae88-191cb3ff2360-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.453770 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.453747 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1a024da6-fa8d-489e-ae88-191cb3ff2360-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.453770 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:53:07.453753 2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 10 12:53:07.454047 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.453799 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.454047 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:53:07.453822 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-tls podName:1a024da6-fa8d-489e-ae88-191cb3ff2360 nodeName:}" failed. No retries permitted until 2026-06-10 12:53:07.953798887 +0000 UTC m=+302.506323651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-7km9w" (UID: "1a024da6-fa8d-489e-ae88-191cb3ff2360") : secret "kube-state-metrics-tls" not found Jun 10 12:53:07.454477 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.454450 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1a024da6-fa8d-489e-ae88-191cb3ff2360-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.454753 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.454682 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.454856 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.454761 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a024da6-fa8d-489e-ae88-191cb3ff2360-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.456234 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.456216 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.467226 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.467207 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f7j89"] Jun 10 12:53:07.469215 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.469190 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:07.470097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.470070 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8vph\" (UniqueName: \"kubernetes.io/projected/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-api-access-n8vph\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.470700 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.470681 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.473095 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.473072 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 12:53:07.473289 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.473209 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 12:53:07.473289 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.473264 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 12:53:07.473289 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.473283 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-29x2b\"" Jun 10 12:53:07.534784 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.534713 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:07.554439 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.554410 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18dfa9d8-d11d-470e-8996-1bc7309de117-root\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.554552 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.554453 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpmlr\" (UniqueName: \"kubernetes.io/projected/18dfa9d8-d11d-470e-8996-1bc7309de117-kube-api-access-wpmlr\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.554552 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.554473 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18dfa9d8-d11d-470e-8996-1bc7309de117-metrics-client-ca\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.554552 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.554494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-tls\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.554649 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.554549 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-textfile\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.554649 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.554583 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-wtmp\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.554649 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.554611 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.554735 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.554647 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.554735 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.554672 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18dfa9d8-d11d-470e-8996-1bc7309de117-sys\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.633709 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.633676 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:07.655867 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.655838 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpmlr\" (UniqueName: \"kubernetes.io/projected/18dfa9d8-d11d-470e-8996-1bc7309de117-kube-api-access-wpmlr\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656015 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.655872 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18dfa9d8-d11d-470e-8996-1bc7309de117-metrics-client-ca\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656015 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.655917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-tls\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656015 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.655958 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-textfile\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656015 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.655986 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-wtmp\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656210 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.656064 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656210 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.656106 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656210 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.656113 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-wtmp\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656210 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.656136 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18dfa9d8-d11d-470e-8996-1bc7309de117-sys\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656210 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.656204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18dfa9d8-d11d-470e-8996-1bc7309de117-root\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656457 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.656293 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18dfa9d8-d11d-470e-8996-1bc7309de117-sys\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656457 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.656309 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18dfa9d8-d11d-470e-8996-1bc7309de117-root\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656457 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.656380 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-textfile\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656570 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.656528 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18dfa9d8-d11d-470e-8996-1bc7309de117-metrics-client-ca\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.656649 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.656629 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.658296 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.658273 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.658422 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.658402 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18dfa9d8-d11d-470e-8996-1bc7309de117-node-exporter-tls\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.663465 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.663436 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpmlr\" (UniqueName: \"kubernetes.io/projected/18dfa9d8-d11d-470e-8996-1bc7309de117-kube-api-access-wpmlr\") pod \"node-exporter-f7j89\" (UID: \"18dfa9d8-d11d-470e-8996-1bc7309de117\") " pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.735234 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.735198 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:07.787013 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.786929 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f7j89" Jun 10 12:53:07.799352 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:53:07.799321 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18dfa9d8_d11d_470e_8996_1bc7309de117.slice/crio-72fc298853e65d59336031365841c92bc62fe784554dc5e06696ac39eb697a69 WatchSource:0}: Error finding container 72fc298853e65d59336031365841c92bc62fe784554dc5e06696ac39eb697a69: Status 404 returned error can't find the container with id 72fc298853e65d59336031365841c92bc62fe784554dc5e06696ac39eb697a69 Jun 10 12:53:07.801343 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.801327 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:53:07.835618 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.835594 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:07.959441 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.959412 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.962216 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.962188 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1a024da6-fa8d-489e-ae88-191cb3ff2360-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-7km9w\" (UID: \"1a024da6-fa8d-489e-ae88-191cb3ff2360\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:07.985325 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:07.985294 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:08.040922 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.040820 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7j89" event={"ID":"18dfa9d8-d11d-470e-8996-1bc7309de117","Type":"ContainerStarted","Data":"72fc298853e65d59336031365841c92bc62fe784554dc5e06696ac39eb697a69"} Jun 10 12:53:08.171391 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.171345 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:08.233165 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.233133 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" Jun 10 12:53:08.361785 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.361666 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:08.391490 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.391454 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w"] Jun 10 12:53:08.443555 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.443515 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:53:08.447367 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.447347 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.449899 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.449769 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 12:53:08.449899 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.449774 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 12:53:08.449899 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.449801 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 12:53:08.449899 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.449817 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 12:53:08.450178 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.450031 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 12:53:08.450178 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.450094 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2z46m\"" Jun 10 12:53:08.450178 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.450138 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 12:53:08.450490 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.450421 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 12:53:08.450690 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.450669 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 12:53:08.450768 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.450731 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 12:53:08.451598 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.451578 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:08.461476 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.461453 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:53:08.564521 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564489 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.564722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564551 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.564722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564580 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.564722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564605 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.564722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564634 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.564722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564673 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-config-out\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.564722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564692 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c5tv\" (UniqueName: \"kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-kube-api-access-4c5tv\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.564722 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564716 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.565031 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564824 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-web-config\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.565031 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564856 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.565031 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564911 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.565031 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564942 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.565031 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.564971 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.666418 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666379 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.666607 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.666607 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666468 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.666607 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666500 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.666607 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666542 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-config-out\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.666607 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666569 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c5tv\" (UniqueName: \"kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-kube-api-access-4c5tv\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.666607 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666597 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.667004 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666647 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-web-config\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.667004 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666675 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.667004 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666713 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.667004 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666744 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.667004 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666773 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.667004 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.666809 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.667673 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.667642 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.667673 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.667658 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.668478 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:53:08.668450 2570 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 12:53:08.668599 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:53:08.668580 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-main-tls podName:2e3490ee-7651-4a7a-b079-2341de10af63 nodeName:}" failed. No retries permitted until 2026-06-10 12:53:09.168561018 +0000 UTC m=+303.721085788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63") : secret "alertmanager-main-tls" not found Jun 10 12:53:08.671819 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.671752 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.671945 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.671912 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.672010 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.671977 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-config-out\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.675472 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.672811 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.675472 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.672819 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.676497 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.676451 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.676592 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.676560 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-config-volume\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.676739 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.676650 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-web-config\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.677747 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.677727 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.681267 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.681230 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c5tv\" (UniqueName: \"kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-kube-api-access-4c5tv\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:08.813076 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:08.813034 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:09.170954 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:09.170910 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:09.173417 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:09.173390 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:09.369850 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:09.369810 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:53:10.452407 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:10.452370 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:10.506978 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:10.506943 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:10.606609 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:10.606579 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:10.718453 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:10.718355 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:10.820251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:10.820216 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:11.036357 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:11.036271 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:11.097502 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:11.097465 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:11.207497 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:11.207462 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:11.301178 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:11.301092 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:11.838239 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:11.838205 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:11.904899 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:11.904845 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:12.161596 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:12.161518 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:12.250162 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:12.250122 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:12.469209 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:12.469128 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:13.832686 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:13.832643 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:15.071449 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:53:15.071418 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a024da6_fa8d_489e_ae88_191cb3ff2360.slice/crio-5076f86acd5b084ca8d4a32e7c35ccfde6cc066761e953c00b0219e80df4aea6 WatchSource:0}: Error finding container 5076f86acd5b084ca8d4a32e7c35ccfde6cc066761e953c00b0219e80df4aea6: Status 404 returned error can't find the container with id 5076f86acd5b084ca8d4a32e7c35ccfde6cc066761e953c00b0219e80df4aea6 Jun 10 12:53:15.141894 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:15.141858 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:53:15.462044 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:15.462006 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:53:15.466395 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:53:15.466346 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3490ee_7651_4a7a_b079_2341de10af63.slice/crio-a464277c3827de3cef7c9194bb4b9f42f6dd8dd35a4d5f995d1cfa515527b7d2 WatchSource:0}: Error finding container a464277c3827de3cef7c9194bb4b9f42f6dd8dd35a4d5f995d1cfa515527b7d2: Status 404 returned error can't find the container with id a464277c3827de3cef7c9194bb4b9f42f6dd8dd35a4d5f995d1cfa515527b7d2 Jun 10 12:53:15.925652 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:15.925619 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:53:16.073479 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:16.073339 2570 generic.go:356] "Generic (PLEG): container finished" podID="18dfa9d8-d11d-470e-8996-1bc7309de117" containerID="50436548c6f66a5900360db8f97d3fce1905a297cc5a684a62f86abd5386ed52" exitCode=0 Jun 10 12:53:16.073479 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:16.073423 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7j89" event={"ID":"18dfa9d8-d11d-470e-8996-1bc7309de117","Type":"ContainerDied","Data":"50436548c6f66a5900360db8f97d3fce1905a297cc5a684a62f86abd5386ed52"} Jun 10 12:53:16.080452 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:16.078273 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerStarted","Data":"a464277c3827de3cef7c9194bb4b9f42f6dd8dd35a4d5f995d1cfa515527b7d2"} Jun 10 12:53:16.081371 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:16.081341 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-fmdnf" event={"ID":"33576003-7473-4ff4-b870-562b12a0ea2d","Type":"ContainerStarted","Data":"3651fb45f291d9b969e85a18a63958b4ce4e15cad71bb8d824f10eb45c496e73"} Jun 10 12:53:16.081833 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:16.081667 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-fmdnf" Jun 10 12:53:16.084251 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:16.084192 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" event={"ID":"1a024da6-fa8d-489e-ae88-191cb3ff2360","Type":"ContainerStarted","Data":"5076f86acd5b084ca8d4a32e7c35ccfde6cc066761e953c00b0219e80df4aea6"} Jun 10 12:53:16.091986 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:16.091963 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-fmdnf" Jun 10 12:53:16.594298 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:16.594230 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:16.994576 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:16.994547 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78b6d5dcd4-twlsm" Jun 10 12:53:17.023946 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.022539 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-fmdnf" podStartSLOduration=3.023602414 podStartE2EDuration="22.022516359s" totalImagesPullingTime="18.998913945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:53:16.115065681 +0000 UTC m=+310.667590453" watchObservedRunningTime="2026-06-10 12:53:17.022516359 +0000 UTC m=+311.575041139" Jun 10 12:53:17.097173 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.097083 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7j89" event={"ID":"18dfa9d8-d11d-470e-8996-1bc7309de117","Type":"ContainerStarted","Data":"91e4c7f12d23d2a5ff4c5d3d4e1ea5477394bcfa903eacf0b44aaeb3c0b6c81d"} Jun 10 12:53:17.097764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.097736 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7j89" event={"ID":"18dfa9d8-d11d-470e-8996-1bc7309de117","Type":"ContainerStarted","Data":"63f24dc0a733bb8c6f782afba8e4054bab613abc74c772bf787e666e8b986528"} Jun 10 12:53:17.101312 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.101284 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e3490ee-7651-4a7a-b079-2341de10af63" containerID="0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333" exitCode=0 Jun 10 12:53:17.101427 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.101418 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerDied","Data":"0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333"} Jun 10 12:53:17.105442 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.105328 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" event={"ID":"1a024da6-fa8d-489e-ae88-191cb3ff2360","Type":"ContainerStarted","Data":"c1f12f61aeca608a5936585e782dd8d4a89015ae28e910ab79a405e4e8869bc0"} Jun 10 12:53:17.105442 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.105373 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" event={"ID":"1a024da6-fa8d-489e-ae88-191cb3ff2360","Type":"ContainerStarted","Data":"528b94de3c8a013d63e24bbcdac695e1813623066af7da01a9695835bf582e10"} Jun 10 12:53:17.105442 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.105399 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" event={"ID":"1a024da6-fa8d-489e-ae88-191cb3ff2360","Type":"ContainerStarted","Data":"927f9a9d5f5c8b5dcc5ca5ede8739766a6e12ed0e60fd6b2a69dd24fe0593bdd"} Jun 10 12:53:17.135505 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.135459 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f7j89" podStartSLOduration=2.5409405940000003 podStartE2EDuration="10.135445835s" totalImagesPullingTime="7.522676464s" totalInitContainerRuntime="71.828777ms" isStatefulPod=true podCreationTimestamp="2026-06-10 12:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:53:17.132116508 +0000 UTC m=+311.684641318" watchObservedRunningTime="2026-06-10 12:53:17.135445835 +0000 UTC m=+311.687970621" Jun 10 12:53:17.165475 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.165416 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-7km9w" podStartSLOduration=8.530095225 podStartE2EDuration="10.16539761s" totalImagesPullingTime="1.635302385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:53:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:53:17.164113822 +0000 UTC m=+311.716638600" watchObservedRunningTime="2026-06-10 12:53:17.16539761 +0000 UTC m=+311.717922391" Jun 10 12:53:17.219708 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.219667 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:17.326457 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.326415 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:17.426372 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:17.426296 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:19.074437 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:19.074395 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:19.116120 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:19.116091 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerStarted","Data":"ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac"} Jun 10 12:53:19.116222 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:19.116173 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerStarted","Data":"d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239"} Jun 10 12:53:19.171313 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:19.171284 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:19.271218 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:19.271192 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:19.585663 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:19.585629 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:19.683049 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:19.683021 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:19.783684 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:19.783652 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:19.847856 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:19.847781 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:20.123990 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.123917 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerStarted","Data":"249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7"} Jun 10 12:53:20.124459 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.123999 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerStarted","Data":"9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1"} Jun 10 12:53:20.124459 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.124035 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerStarted","Data":"59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b"} Jun 10 12:53:20.154680 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.154642 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" podUID="4bd1b4f1-d8c2-412f-bfee-f9234935526c" containerName="registry" containerID="cri-o://c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581" gracePeriod=30 Jun 10 12:53:20.643379 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.643343 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:53:20.781439 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.781414 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-certificates\") pod \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " Jun 10 12:53:20.781549 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.781457 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-installation-pull-secrets\") pod \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " Jun 10 12:53:20.781549 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.781501 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls\") pod \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " Jun 10 12:53:20.781549 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.781528 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhq79\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-kube-api-access-hhq79\") pod \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " Jun 10 12:53:20.781702 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.781562 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-image-registry-private-configuration\") pod \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " Jun 10 12:53:20.781702 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.781622 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-trusted-ca\") pod \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " Jun 10 12:53:20.781702 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.781656 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bd1b4f1-d8c2-412f-bfee-f9234935526c-ca-trust-extracted\") pod \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " Jun 10 12:53:20.781847 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.781702 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-bound-sa-token\") pod \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\" (UID: \"4bd1b4f1-d8c2-412f-bfee-f9234935526c\") " Jun 10 12:53:20.781847 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.781784 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4bd1b4f1-d8c2-412f-bfee-f9234935526c" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:53:20.782002 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.781977 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-certificates\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:53:20.782379 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.782333 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4bd1b4f1-d8c2-412f-bfee-f9234935526c" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:53:20.784249 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.784138 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4bd1b4f1-d8c2-412f-bfee-f9234935526c" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:53:20.784249 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.784190 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4bd1b4f1-d8c2-412f-bfee-f9234935526c" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:53:20.784403 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.784375 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4bd1b4f1-d8c2-412f-bfee-f9234935526c" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:53:20.784574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.784546 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-kube-api-access-hhq79" (OuterVolumeSpecName: "kube-api-access-hhq79") pod "4bd1b4f1-d8c2-412f-bfee-f9234935526c" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c"). InnerVolumeSpecName "kube-api-access-hhq79". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:53:20.784841 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.784818 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4bd1b4f1-d8c2-412f-bfee-f9234935526c" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:53:20.792219 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.792193 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd1b4f1-d8c2-412f-bfee-f9234935526c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4bd1b4f1-d8c2-412f-bfee-f9234935526c" (UID: "4bd1b4f1-d8c2-412f-bfee-f9234935526c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:53:20.882736 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.882667 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-registry-tls\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:53:20.882736 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.882697 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhq79\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-kube-api-access-hhq79\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:53:20.882736 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.882709 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-image-registry-private-configuration\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:53:20.882736 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.882717 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4bd1b4f1-d8c2-412f-bfee-f9234935526c-trusted-ca\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:53:20.882736 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.882726 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4bd1b4f1-d8c2-412f-bfee-f9234935526c-ca-trust-extracted\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:53:20.882736 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.882734 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4bd1b4f1-d8c2-412f-bfee-f9234935526c-bound-sa-token\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:53:20.883075 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:20.882742 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4bd1b4f1-d8c2-412f-bfee-f9234935526c-installation-pull-secrets\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:53:21.133145 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.133064 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerStarted","Data":"5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2"} Jun 10 12:53:21.142089 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.142057 2570 generic.go:356] "Generic (PLEG): container finished" podID="4bd1b4f1-d8c2-412f-bfee-f9234935526c" containerID="c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581" exitCode=0 Jun 10 12:53:21.142226 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.142118 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" Jun 10 12:53:21.142226 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.142124 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" event={"ID":"4bd1b4f1-d8c2-412f-bfee-f9234935526c","Type":"ContainerDied","Data":"c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581"} Jun 10 12:53:21.142226 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.142196 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b695996c5-pbht8" event={"ID":"4bd1b4f1-d8c2-412f-bfee-f9234935526c","Type":"ContainerDied","Data":"37a62ca79686f3679eef8de58b7a17961dbc7542bacd64f2cd212e7b7032dcf5"} Jun 10 12:53:21.142226 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.142226 2570 scope.go:117] "RemoveContainer" containerID="c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581" Jun 10 12:53:21.156363 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.156186 2570 scope.go:117] "RemoveContainer" containerID="c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581" Jun 10 12:53:21.156484 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:53:21.156462 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581\": container with ID starting with c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581 not found: ID does not exist" containerID="c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581" Jun 10 12:53:21.156539 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.156490 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581"} err="failed to get container status \"c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581\": rpc error: code = NotFound desc = could not find container \"c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581\": container with ID starting with c5f7586817268de6be0934ebe321df5848b05dedde24a100469555271dfa7581 not found: ID does not exist" Jun 10 12:53:21.163229 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.163191 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.955695191 podStartE2EDuration="13.163177844s" totalImagesPullingTime="4.187399935s" totalInitContainerRuntime="20.082718ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:53:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:53:21.161281271 +0000 UTC m=+315.713806071" watchObservedRunningTime="2026-06-10 12:53:21.163177844 +0000 UTC m=+315.715702622" Jun 10 12:53:21.176566 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.176511 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b695996c5-pbht8"] Jun 10 12:53:21.182983 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.182959 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b695996c5-pbht8"] Jun 10 12:53:21.929162 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:21.929126 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bd1b4f1-d8c2-412f-bfee-f9234935526c" path="/var/lib/kubelet/pods/4bd1b4f1-d8c2-412f-bfee-f9234935526c/volumes" Jun 10 12:53:22.396116 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:22.396081 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:22.496799 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:22.496764 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:27.299130 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:27.299097 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:27.400070 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:27.400037 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:27.500263 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:27.500236 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:28.398205 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:28.398173 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:28.498080 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:28.498046 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:31.089031 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:31.088999 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:31.189636 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:31.189581 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:31.291181 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:31.291161 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:42.306848 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:42.306812 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:42.366939 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:42.366913 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:53:52.258380 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:52.258348 2570 generic.go:356] "Generic (PLEG): container finished" podID="8c58c9f2-1625-49f8-8714-82d111c716f1" containerID="a4081a118cb3055087ac47dbc8adeff1154c3e7968ac069fc1152da222906821" exitCode=0 Jun 10 12:53:52.258753 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:52.258391 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xfw7w" event={"ID":"8c58c9f2-1625-49f8-8714-82d111c716f1","Type":"ContainerDied","Data":"a4081a118cb3055087ac47dbc8adeff1154c3e7968ac069fc1152da222906821"} Jun 10 12:53:52.258753 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:52.258701 2570 scope.go:117] "RemoveContainer" containerID="a4081a118cb3055087ac47dbc8adeff1154c3e7968ac069fc1152da222906821" Jun 10 12:53:53.264529 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:53:53.264495 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-xfw7w" event={"ID":"8c58c9f2-1625-49f8-8714-82d111c716f1","Type":"ContainerStarted","Data":"b6616ff6f7a628079c644f1c83f2354adc78b1bd2da654d2d2e9c1631ff9fc8d"} Jun 10 12:54:08.592204 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:08.592171 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:18.914241 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:18.914205 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:54:18.916550 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:18.916522 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19924bce-75e7-45a1-8222-5f6b693f9dc4-metrics-certs\") pod \"network-metrics-daemon-pgwrf\" (UID: \"19924bce-75e7-45a1-8222-5f6b693f9dc4\") " pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:54:18.929085 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:18.929061 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7d5dq\"" Jun 10 12:54:18.937488 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:18.937469 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pgwrf" Jun 10 12:54:19.066010 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:19.065986 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pgwrf"] Jun 10 12:54:19.066206 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:54:19.066174 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19924bce_75e7_45a1_8222_5f6b693f9dc4.slice/crio-636899c919d36d719f910bc031dd4640b5ec1c5ba1e87145d6e9f7cb5235726e WatchSource:0}: Error finding container 636899c919d36d719f910bc031dd4640b5ec1c5ba1e87145d6e9f7cb5235726e: Status 404 returned error can't find the container with id 636899c919d36d719f910bc031dd4640b5ec1c5ba1e87145d6e9f7cb5235726e Jun 10 12:54:19.159341 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:19.159316 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:19.229089 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:19.229018 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:19.363937 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:19.363905 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pgwrf" event={"ID":"19924bce-75e7-45a1-8222-5f6b693f9dc4","Type":"ContainerStarted","Data":"636899c919d36d719f910bc031dd4640b5ec1c5ba1e87145d6e9f7cb5235726e"} Jun 10 12:54:20.190798 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:20.190728 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:20.250416 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:20.250389 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:20.369166 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:20.369135 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pgwrf" event={"ID":"19924bce-75e7-45a1-8222-5f6b693f9dc4","Type":"ContainerStarted","Data":"43297ed2f883fa29ff7f96eb936cf4aff9e1b68bed654dac402baba62d5ad4b9"} Jun 10 12:54:20.369284 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:20.369182 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pgwrf" event={"ID":"19924bce-75e7-45a1-8222-5f6b693f9dc4","Type":"ContainerStarted","Data":"9ff21c572af3a24cf27ae6959505f57029026807b36801602e5008541fc169df"} Jun 10 12:54:20.390692 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:20.390648 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pgwrf" podStartSLOduration=373.622190516 podStartE2EDuration="6m14.390633691s" totalImagesPullingTime="768.443175ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:54:20.38914962 +0000 UTC m=+374.941674410" watchObservedRunningTime="2026-06-10 12:54:20.390633691 +0000 UTC m=+374.943158470" Jun 10 12:54:20.540173 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:20.540102 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:20.929235 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:20.929208 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:21.004527 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:21.004499 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:23.633440 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:23.633403 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:23.735013 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:23.734978 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:27.966745 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:27.966710 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:54:27.967138 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:27.966987 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="alertmanager" containerID="cri-o://d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239" gracePeriod=120 Jun 10 12:54:27.967138 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:27.967037 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy-metric" containerID="cri-o://249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7" gracePeriod=120 Jun 10 12:54:27.967138 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:27.967085 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="config-reloader" containerID="cri-o://ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac" gracePeriod=120 Jun 10 12:54:27.967303 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:27.967124 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="prom-label-proxy" containerID="cri-o://5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2" gracePeriod=120 Jun 10 12:54:27.967303 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:27.967129 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy" containerID="cri-o://9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1" gracePeriod=120 Jun 10 12:54:27.967303 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:27.967068 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy-web" containerID="cri-o://59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b" gracePeriod=120 Jun 10 12:54:28.404356 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:28.404322 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e3490ee-7651-4a7a-b079-2341de10af63" containerID="5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2" exitCode=0 Jun 10 12:54:28.404356 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:28.404344 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e3490ee-7651-4a7a-b079-2341de10af63" containerID="9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1" exitCode=0 Jun 10 12:54:28.404356 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:28.404358 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e3490ee-7651-4a7a-b079-2341de10af63" containerID="ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac" exitCode=0 Jun 10 12:54:28.404622 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:28.404364 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e3490ee-7651-4a7a-b079-2341de10af63" containerID="d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239" exitCode=0 Jun 10 12:54:28.404622 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:28.404396 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerDied","Data":"5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2"} Jun 10 12:54:28.404622 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:28.404474 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerDied","Data":"9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1"} Jun 10 12:54:28.404622 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:28.404513 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerDied","Data":"ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac"} Jun 10 12:54:28.404622 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:28.404553 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerDied","Data":"d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239"} Jun 10 12:54:29.215628 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.215600 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.293152 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293095 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293152 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293135 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293152 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293152 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-web\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293446 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293175 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-trusted-ca-bundle\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293446 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293200 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-cluster-tls-config\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293446 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293235 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-config-volume\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293446 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293276 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-main-tls\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293446 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293307 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-tls-assets\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293446 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293329 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-main-db\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293446 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293376 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-config-out\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293446 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293401 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-web-config\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293446 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293440 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c5tv\" (UniqueName: \"kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-kube-api-access-4c5tv\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293866 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293470 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-metrics-client-ca\") pod \"2e3490ee-7651-4a7a-b079-2341de10af63\" (UID: \"2e3490ee-7651-4a7a-b079-2341de10af63\") " Jun 10 12:54:29.293866 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293600 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:54:29.293866 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.293747 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:54:29.294091 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.294011 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:54:29.295959 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.295931 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:54:29.296551 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.296521 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:54:29.296691 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.296671 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-kube-api-access-4c5tv" (OuterVolumeSpecName: "kube-api-access-4c5tv") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "kube-api-access-4c5tv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:54:29.296977 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.296947 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-config-out" (OuterVolumeSpecName: "config-out") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:54:29.297333 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.297303 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-config-volume" (OuterVolumeSpecName: "config-volume") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:54:29.297704 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.297675 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:54:29.297799 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.297751 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:54:29.297917 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.297894 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:54:29.301795 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.301773 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:54:29.307089 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.307070 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-web-config" (OuterVolumeSpecName: "web-config") pod "2e3490ee-7651-4a7a-b079-2341de10af63" (UID: "2e3490ee-7651-4a7a-b079-2341de10af63"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:54:29.394988 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.394969 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-config-out\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.394988 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.394989 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-web-config\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.394997 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c5tv\" (UniqueName: \"kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-kube-api-access-4c5tv\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.395008 2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-metrics-client-ca\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.395018 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.395026 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.395035 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.395044 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.395052 2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-cluster-tls-config\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.395060 2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-config-volume\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.395068 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2e3490ee-7651-4a7a-b079-2341de10af63-secret-alertmanager-main-tls\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.395076 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2e3490ee-7651-4a7a-b079-2341de10af63-tls-assets\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.395097 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.395084 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2e3490ee-7651-4a7a-b079-2341de10af63-alertmanager-main-db\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 12:54:29.411546 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.411520 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e3490ee-7651-4a7a-b079-2341de10af63" containerID="249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7" exitCode=0 Jun 10 12:54:29.411546 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.411542 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e3490ee-7651-4a7a-b079-2341de10af63" containerID="59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b" exitCode=0 Jun 10 12:54:29.411742 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.411605 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.411742 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.411606 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerDied","Data":"249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7"} Jun 10 12:54:29.411742 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.411700 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerDied","Data":"59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b"} Jun 10 12:54:29.411863 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.411749 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2e3490ee-7651-4a7a-b079-2341de10af63","Type":"ContainerDied","Data":"a464277c3827de3cef7c9194bb4b9f42f6dd8dd35a4d5f995d1cfa515527b7d2"} Jun 10 12:54:29.411863 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.411769 2570 scope.go:117] "RemoveContainer" containerID="5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2" Jun 10 12:54:29.422187 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.420699 2570 scope.go:117] "RemoveContainer" containerID="249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7" Jun 10 12:54:29.429591 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.429569 2570 scope.go:117] "RemoveContainer" containerID="9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1" Jun 10 12:54:29.436101 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.436081 2570 scope.go:117] "RemoveContainer" containerID="59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b" Jun 10 12:54:29.440558 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.440536 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:54:29.442930 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.442910 2570 scope.go:117] "RemoveContainer" containerID="ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac" Jun 10 12:54:29.445165 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.445147 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:54:29.449930 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.449914 2570 scope.go:117] "RemoveContainer" containerID="d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239" Jun 10 12:54:29.456374 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.456356 2570 scope.go:117] "RemoveContainer" containerID="0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333" Jun 10 12:54:29.462723 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.462706 2570 scope.go:117] "RemoveContainer" containerID="5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2" Jun 10 12:54:29.462971 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:54:29.462952 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2\": container with ID starting with 5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2 not found: ID does not exist" containerID="5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2" Jun 10 12:54:29.463021 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.462978 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2"} err="failed to get container status \"5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2\": rpc error: code = NotFound desc = could not find container \"5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2\": container with ID starting with 5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2 not found: ID does not exist" Jun 10 12:54:29.463021 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.462994 2570 scope.go:117] "RemoveContainer" containerID="249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7" Jun 10 12:54:29.463210 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:54:29.463192 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7\": container with ID starting with 249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7 not found: ID does not exist" containerID="249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7" Jun 10 12:54:29.463273 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.463220 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7"} err="failed to get container status \"249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7\": rpc error: code = NotFound desc = could not find container \"249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7\": container with ID starting with 249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7 not found: ID does not exist" Jun 10 12:54:29.463273 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.463241 2570 scope.go:117] "RemoveContainer" containerID="9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1" Jun 10 12:54:29.463475 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:54:29.463460 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1\": container with ID starting with 9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1 not found: ID does not exist" containerID="9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1" Jun 10 12:54:29.463513 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.463480 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1"} err="failed to get container status \"9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1\": rpc error: code = NotFound desc = could not find container \"9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1\": container with ID starting with 9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1 not found: ID does not exist" Jun 10 12:54:29.463513 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.463493 2570 scope.go:117] "RemoveContainer" containerID="59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b" Jun 10 12:54:29.463702 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:54:29.463684 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b\": container with ID starting with 59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b not found: ID does not exist" containerID="59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b" Jun 10 12:54:29.463743 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.463707 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b"} err="failed to get container status \"59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b\": rpc error: code = NotFound desc = could not find container \"59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b\": container with ID starting with 59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b not found: ID does not exist" Jun 10 12:54:29.463743 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.463722 2570 scope.go:117] "RemoveContainer" containerID="ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac" Jun 10 12:54:29.463953 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:54:29.463936 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac\": container with ID starting with ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac not found: ID does not exist" containerID="ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac" Jun 10 12:54:29.464021 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.463961 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac"} err="failed to get container status \"ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac\": rpc error: code = NotFound desc = could not find container \"ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac\": container with ID starting with ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac not found: ID does not exist" Jun 10 12:54:29.464021 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.463980 2570 scope.go:117] "RemoveContainer" containerID="d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239" Jun 10 12:54:29.464196 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:54:29.464180 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239\": container with ID starting with d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239 not found: ID does not exist" containerID="d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239" Jun 10 12:54:29.464234 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.464199 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239"} err="failed to get container status \"d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239\": rpc error: code = NotFound desc = could not find container \"d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239\": container with ID starting with d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239 not found: ID does not exist" Jun 10 12:54:29.464234 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.464212 2570 scope.go:117] "RemoveContainer" containerID="0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333" Jun 10 12:54:29.464419 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:54:29.464405 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333\": container with ID starting with 0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333 not found: ID does not exist" containerID="0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333" Jun 10 12:54:29.464464 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.464423 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333"} err="failed to get container status \"0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333\": rpc error: code = NotFound desc = could not find container \"0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333\": container with ID starting with 0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333 not found: ID does not exist" Jun 10 12:54:29.464464 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.464436 2570 scope.go:117] "RemoveContainer" containerID="5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2" Jun 10 12:54:29.464637 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.464621 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2"} err="failed to get container status \"5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2\": rpc error: code = NotFound desc = could not find container \"5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2\": container with ID starting with 5ff0698e399a79dccd91b624e3cd27104b17af8fb1c0615ddfaadb0f3c8519a2 not found: ID does not exist" Jun 10 12:54:29.464735 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.464639 2570 scope.go:117] "RemoveContainer" containerID="249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7" Jun 10 12:54:29.464868 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.464851 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7"} err="failed to get container status \"249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7\": rpc error: code = NotFound desc = could not find container \"249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7\": container with ID starting with 249724c0ce0d08fe39a1df9312ff897aa559ceb65e2cd8b3b301c00756ac4df7 not found: ID does not exist" Jun 10 12:54:29.464996 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.464869 2570 scope.go:117] "RemoveContainer" containerID="9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1" Jun 10 12:54:29.465127 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.465110 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1"} err="failed to get container status \"9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1\": rpc error: code = NotFound desc = could not find container \"9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1\": container with ID starting with 9fbac8d4aeca07c193d1e607b983bd125da85c2f3a694e868a29bf7c1b2914f1 not found: ID does not exist" Jun 10 12:54:29.465237 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.465128 2570 scope.go:117] "RemoveContainer" containerID="59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b" Jun 10 12:54:29.465445 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.465411 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b"} err="failed to get container status \"59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b\": rpc error: code = NotFound desc = could not find container \"59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b\": container with ID starting with 59bbc0000a7e21c51622c48eb97468ce3b2942c61b9d77c207f868d85c01cd2b not found: ID does not exist" Jun 10 12:54:29.465445 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.465436 2570 scope.go:117] "RemoveContainer" containerID="ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac" Jun 10 12:54:29.465699 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.465675 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac"} err="failed to get container status \"ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac\": rpc error: code = NotFound desc = could not find container \"ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac\": container with ID starting with ccb830c67899f58abe4a8cb9fe7d2c8cd7c3561e58b0e4950f860a613eefe3ac not found: ID does not exist" Jun 10 12:54:29.465699 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.465698 2570 scope.go:117] "RemoveContainer" containerID="d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239" Jun 10 12:54:29.465936 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.465915 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239"} err="failed to get container status \"d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239\": rpc error: code = NotFound desc = could not find container \"d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239\": container with ID starting with d026a2f678032e2f09d61f5d0fa0aca550cabcfc2dc571aa76b8e6379c3ca239 not found: ID does not exist" Jun 10 12:54:29.465995 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.465938 2570 scope.go:117] "RemoveContainer" containerID="0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333" Jun 10 12:54:29.466131 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.466116 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333"} err="failed to get container status \"0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333\": rpc error: code = NotFound desc = could not find container \"0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333\": container with ID starting with 0cb308484110a11c75f5cf730f9e5c9594224eff2449c880d463a91619ba5333 not found: ID does not exist" Jun 10 12:54:29.475100 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475082 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:54:29.475369 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475356 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="init-config-reloader" Jun 10 12:54:29.475420 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475370 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="init-config-reloader" Jun 10 12:54:29.475420 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475386 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd1b4f1-d8c2-412f-bfee-f9234935526c" containerName="registry" Jun 10 12:54:29.475420 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475391 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd1b4f1-d8c2-412f-bfee-f9234935526c" containerName="registry" Jun 10 12:54:29.475420 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475401 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="alertmanager" Jun 10 12:54:29.475420 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475406 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="alertmanager" Jun 10 12:54:29.475420 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475412 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy" Jun 10 12:54:29.475420 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475418 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475426 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy-metric" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475431 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy-metric" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475436 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="prom-label-proxy" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475441 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="prom-label-proxy" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475449 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="config-reloader" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475453 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="config-reloader" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475459 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy-web" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475464 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy-web" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475505 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy-web" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475511 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="prom-label-proxy" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475517 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="config-reloader" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475523 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy-metric" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475529 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd1b4f1-d8c2-412f-bfee-f9234935526c" containerName="registry" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475535 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="kube-rbac-proxy" Jun 10 12:54:29.475615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.475541 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" containerName="alertmanager" Jun 10 12:54:29.479071 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.479055 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.481906 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.481888 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 12:54:29.482009 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.481922 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 12:54:29.482009 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.481888 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 12:54:29.482190 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.482176 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 12:54:29.482260 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.482243 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2z46m\"" Jun 10 12:54:29.482300 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.482281 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 12:54:29.482300 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.482289 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 12:54:29.482371 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.482315 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 12:54:29.482595 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.482579 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 12:54:29.487210 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.487188 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 12:54:29.497746 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.497722 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:54:29.597483 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597459 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597488 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9wr\" (UniqueName: \"kubernetes.io/projected/1a4c6149-0942-4885-9aec-33559091b5c3-kube-api-access-kk9wr\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597507 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-web-config\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597534 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597687 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597614 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a4c6149-0942-4885-9aec-33559091b5c3-config-out\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597687 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597642 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a4c6149-0942-4885-9aec-33559091b5c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597687 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597659 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4c6149-0942-4885-9aec-33559091b5c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597687 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597682 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a4c6149-0942-4885-9aec-33559091b5c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597825 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597825 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597749 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597825 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597765 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597825 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597790 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a4c6149-0942-4885-9aec-33559091b5c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.597825 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.597807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.698741 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698717 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.698843 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.698843 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698763 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a4c6149-0942-4885-9aec-33559091b5c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.698843 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698778 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.698843 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698803 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.698843 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698817 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9wr\" (UniqueName: \"kubernetes.io/projected/1a4c6149-0942-4885-9aec-33559091b5c3-kube-api-access-kk9wr\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.698843 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698836 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-web-config\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.699153 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698866 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.699153 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698925 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a4c6149-0942-4885-9aec-33559091b5c3-config-out\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.699153 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698950 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a4c6149-0942-4885-9aec-33559091b5c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.699153 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.698977 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4c6149-0942-4885-9aec-33559091b5c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.699153 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.699005 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a4c6149-0942-4885-9aec-33559091b5c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.699153 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.699033 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.699452 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.699175 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a4c6149-0942-4885-9aec-33559091b5c3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.700252 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.700022 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a4c6149-0942-4885-9aec-33559091b5c3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.700252 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.700207 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a4c6149-0942-4885-9aec-33559091b5c3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.701819 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.701785 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a4c6149-0942-4885-9aec-33559091b5c3-config-out\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.701939 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.701848 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a4c6149-0942-4885-9aec-33559091b5c3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.701939 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.701866 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.701939 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.701909 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.702095 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.702005 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.702293 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.702275 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.702808 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.702789 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-web-config\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.702906 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.702822 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.703691 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.703670 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a4c6149-0942-4885-9aec-33559091b5c3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.707570 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.707554 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9wr\" (UniqueName: \"kubernetes.io/projected/1a4c6149-0942-4885-9aec-33559091b5c3-kube-api-access-kk9wr\") pod \"alertmanager-main-0\" (UID: \"1a4c6149-0942-4885-9aec-33559091b5c3\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.788595 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.788574 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:54:29.920166 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.920141 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:54:29.921090 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:54:29.921066 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4c6149_0942_4885_9aec_33559091b5c3.slice/crio-856e2d11250ad17ff4726043787584dcb59c63f2e421b7873f01034445542c01 WatchSource:0}: Error finding container 856e2d11250ad17ff4726043787584dcb59c63f2e421b7873f01034445542c01: Status 404 returned error can't find the container with id 856e2d11250ad17ff4726043787584dcb59c63f2e421b7873f01034445542c01 Jun 10 12:54:29.927111 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:29.927091 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e3490ee-7651-4a7a-b079-2341de10af63" path="/var/lib/kubelet/pods/2e3490ee-7651-4a7a-b079-2341de10af63/volumes" Jun 10 12:54:30.418507 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:30.418474 2570 generic.go:356] "Generic (PLEG): container finished" podID="1a4c6149-0942-4885-9aec-33559091b5c3" containerID="5a7f222eaa46fc80ad39c9bbdbf7a8c24fce4ef78b449df75c62342b1266dad2" exitCode=0 Jun 10 12:54:30.418814 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:30.418543 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a4c6149-0942-4885-9aec-33559091b5c3","Type":"ContainerDied","Data":"5a7f222eaa46fc80ad39c9bbdbf7a8c24fce4ef78b449df75c62342b1266dad2"} Jun 10 12:54:30.418814 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:30.418613 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a4c6149-0942-4885-9aec-33559091b5c3","Type":"ContainerStarted","Data":"856e2d11250ad17ff4726043787584dcb59c63f2e421b7873f01034445542c01"} Jun 10 12:54:31.427461 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:31.427423 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a4c6149-0942-4885-9aec-33559091b5c3","Type":"ContainerStarted","Data":"b7f2db78a2b701150114619b31c560639d08177d5f51dbd7e042ca45dc2a2730"} Jun 10 12:54:31.427854 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:31.427496 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a4c6149-0942-4885-9aec-33559091b5c3","Type":"ContainerStarted","Data":"2bb1e61cf85ea0636f7771ebc0cbad92fadec8ffca7042ff0c5e81b274c0512a"} Jun 10 12:54:31.427854 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:31.427525 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a4c6149-0942-4885-9aec-33559091b5c3","Type":"ContainerStarted","Data":"4af16ac22a98e656187047dc256da29f35c07094b5ad488e8839d822e657f8ea"} Jun 10 12:54:31.427854 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:31.427552 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a4c6149-0942-4885-9aec-33559091b5c3","Type":"ContainerStarted","Data":"ac74915e0efe0eb4ef74681934486837e00680c4be98163739c443f4e6b95437"} Jun 10 12:54:31.427854 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:31.427577 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a4c6149-0942-4885-9aec-33559091b5c3","Type":"ContainerStarted","Data":"143eef655ba9e6d60e115cf926869fce649d98dbd148c199ae4c02486625f8b1"} Jun 10 12:54:31.427854 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:31.427602 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a4c6149-0942-4885-9aec-33559091b5c3","Type":"ContainerStarted","Data":"c8128af61369c67b2bac3fcc384c1cea2cba855da6db498d325633cb6a45e29d"} Jun 10 12:54:31.457442 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:31.457381 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.442678163 podStartE2EDuration="2.457358973s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.68081ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:54:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:54:31.455997526 +0000 UTC m=+386.008522305" watchObservedRunningTime="2026-06-10 12:54:31.457358973 +0000 UTC m=+386.009883774" Jun 10 12:54:33.404596 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:33.404565 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:33.472442 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:33.472419 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:35.479062 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:35.479019 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:35.537376 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:35.537342 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:42.359910 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:42.359857 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:42.459826 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:42.459795 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:42.553153 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:42.553119 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:44.333152 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:44.333119 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:44.432025 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:44.431998 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:54:44.533829 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:54:44.533792 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:55:23.321240 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:23.321154 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:55:23.431389 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:23.431356 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:55:40.150000 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:40.149961 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:55:55.073640 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:55.073603 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:55:55.907501 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:55.907436 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:55:57.230136 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.230105 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk"] Jun 10 12:55:57.233143 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.233129 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" Jun 10 12:55:57.240148 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.240127 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:55:57.240260 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.240224 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5dbgx\"" Jun 10 12:55:57.240456 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.240442 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 12:55:57.247355 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.247336 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk"] Jun 10 12:55:57.302114 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.302072 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph7ws\" (UniqueName: \"kubernetes.io/projected/56ab563c-c42d-42e0-9f9d-a055a6c9a52c-kube-api-access-ph7ws\") pod \"cert-manager-operator-controller-manager-57757f7cfc-87qwk\" (UID: \"56ab563c-c42d-42e0-9f9d-a055a6c9a52c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" Jun 10 12:55:57.302260 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.302143 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ab563c-c42d-42e0-9f9d-a055a6c9a52c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-87qwk\" (UID: \"56ab563c-c42d-42e0-9f9d-a055a6c9a52c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" Jun 10 12:55:57.402891 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.402854 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ab563c-c42d-42e0-9f9d-a055a6c9a52c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-87qwk\" (UID: \"56ab563c-c42d-42e0-9f9d-a055a6c9a52c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" Jun 10 12:55:57.403016 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.402914 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph7ws\" (UniqueName: \"kubernetes.io/projected/56ab563c-c42d-42e0-9f9d-a055a6c9a52c-kube-api-access-ph7ws\") pod \"cert-manager-operator-controller-manager-57757f7cfc-87qwk\" (UID: \"56ab563c-c42d-42e0-9f9d-a055a6c9a52c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" Jun 10 12:55:57.403273 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.403250 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56ab563c-c42d-42e0-9f9d-a055a6c9a52c-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-87qwk\" (UID: \"56ab563c-c42d-42e0-9f9d-a055a6c9a52c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" Jun 10 12:55:57.418864 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.418835 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph7ws\" (UniqueName: \"kubernetes.io/projected/56ab563c-c42d-42e0-9f9d-a055a6c9a52c-kube-api-access-ph7ws\") pod \"cert-manager-operator-controller-manager-57757f7cfc-87qwk\" (UID: \"56ab563c-c42d-42e0-9f9d-a055a6c9a52c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" Jun 10 12:55:57.542001 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.541935 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" Jun 10 12:55:57.672615 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.672594 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk"] Jun 10 12:55:57.675342 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:55:57.675318 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ab563c_c42d_42e0_9f9d_a055a6c9a52c.slice/crio-3a7b6616bcc367c4244333356e7aff1e4e12f428f20d1783468897f30b53b0d0 WatchSource:0}: Error finding container 3a7b6616bcc367c4244333356e7aff1e4e12f428f20d1783468897f30b53b0d0: Status 404 returned error can't find the container with id 3a7b6616bcc367c4244333356e7aff1e4e12f428f20d1783468897f30b53b0d0 Jun 10 12:55:57.773135 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:57.773107 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" event={"ID":"56ab563c-c42d-42e0-9f9d-a055a6c9a52c","Type":"ContainerStarted","Data":"3a7b6616bcc367c4244333356e7aff1e4e12f428f20d1783468897f30b53b0d0"} Jun 10 12:55:59.118819 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:59.118788 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:55:59.219650 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:55:59.219620 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:01.793813 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:01.793768 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" event={"ID":"56ab563c-c42d-42e0-9f9d-a055a6c9a52c","Type":"ContainerStarted","Data":"574a101de5f7e5de36e59c09e0e555da2ef6b34412c6ebe0c2889fcffadd355a"} Jun 10 12:56:01.816019 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:01.815989 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:01.816216 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:01.816070 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-87qwk" podStartSLOduration=1.6354035040000001 podStartE2EDuration="4.816056727s" totalImagesPullingTime="3.180653223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:56:01.814773529 +0000 UTC m=+476.367298318" watchObservedRunningTime="2026-06-10 12:56:01.816056727 +0000 UTC m=+476.368581506" Jun 10 12:56:01.912923 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:01.912894 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:02.284468 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:02.284441 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:02.376899 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:02.376851 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:03.566313 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.566278 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-68mck"] Jun 10 12:56:03.569602 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.569586 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" Jun 10 12:56:03.572084 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.572053 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 12:56:03.572213 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.572086 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 12:56:03.572213 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.572138 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-bnsqg\"" Jun 10 12:56:03.577553 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.577533 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-68mck"] Jun 10 12:56:03.651587 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.651567 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48e88794-8264-4bd8-81c2-7b95d83b1341-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-68mck\" (UID: \"48e88794-8264-4bd8-81c2-7b95d83b1341\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" Jun 10 12:56:03.651698 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.651608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnvsr\" (UniqueName: \"kubernetes.io/projected/48e88794-8264-4bd8-81c2-7b95d83b1341-kube-api-access-tnvsr\") pod \"cert-manager-webhook-7dc76cbb94-68mck\" (UID: \"48e88794-8264-4bd8-81c2-7b95d83b1341\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" Jun 10 12:56:03.752927 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.752900 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48e88794-8264-4bd8-81c2-7b95d83b1341-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-68mck\" (UID: \"48e88794-8264-4bd8-81c2-7b95d83b1341\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" Jun 10 12:56:03.753012 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.752967 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnvsr\" (UniqueName: \"kubernetes.io/projected/48e88794-8264-4bd8-81c2-7b95d83b1341-kube-api-access-tnvsr\") pod \"cert-manager-webhook-7dc76cbb94-68mck\" (UID: \"48e88794-8264-4bd8-81c2-7b95d83b1341\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" Jun 10 12:56:03.761303 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.761268 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/48e88794-8264-4bd8-81c2-7b95d83b1341-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-68mck\" (UID: \"48e88794-8264-4bd8-81c2-7b95d83b1341\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" Jun 10 12:56:03.761382 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.761365 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnvsr\" (UniqueName: \"kubernetes.io/projected/48e88794-8264-4bd8-81c2-7b95d83b1341-kube-api-access-tnvsr\") pod \"cert-manager-webhook-7dc76cbb94-68mck\" (UID: \"48e88794-8264-4bd8-81c2-7b95d83b1341\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" Jun 10 12:56:03.878778 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:03.878756 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" Jun 10 12:56:04.004160 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:04.004046 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-68mck"] Jun 10 12:56:04.005961 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:56:04.005936 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48e88794_8264_4bd8_81c2_7b95d83b1341.slice/crio-4b3730b08cec93125a86a2ec15fb95214436e273c6dba9a3a2c80966ef9e2608 WatchSource:0}: Error finding container 4b3730b08cec93125a86a2ec15fb95214436e273c6dba9a3a2c80966ef9e2608: Status 404 returned error can't find the container with id 4b3730b08cec93125a86a2ec15fb95214436e273c6dba9a3a2c80966ef9e2608 Jun 10 12:56:04.805611 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:04.805578 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" event={"ID":"48e88794-8264-4bd8-81c2-7b95d83b1341","Type":"ContainerStarted","Data":"4b3730b08cec93125a86a2ec15fb95214436e273c6dba9a3a2c80966ef9e2608"} Jun 10 12:56:05.080398 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:05.080312 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:05.176018 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:05.175985 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:05.788678 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:05.788606 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:07.821186 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:07.821154 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" event={"ID":"48e88794-8264-4bd8-81c2-7b95d83b1341","Type":"ContainerStarted","Data":"4d7b695b3455b2cc0cc24e1ebdd9b25a10b81dc5ff24493a20cd62c177349a67"} Jun 10 12:56:07.821684 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:07.821216 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" Jun 10 12:56:07.843177 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:07.843128 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" podStartSLOduration=1.5370279770000002 podStartE2EDuration="4.8431138s" totalImagesPullingTime="3.306085823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:56:07.842094342 +0000 UTC m=+482.394619156" watchObservedRunningTime="2026-06-10 12:56:07.8431138 +0000 UTC m=+482.395638590" Jun 10 12:56:11.155565 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:11.155532 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:11.256014 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:11.255978 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:13.530862 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:13.530832 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:13.827055 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:13.826975 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-68mck" Jun 10 12:56:16.275209 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:16.275175 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:16.375624 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:16.375595 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:16.994957 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:16.994929 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-bwzm5"] Jun 10 12:56:16.998106 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:16.998084 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-bwzm5" Jun 10 12:56:17.001645 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.001625 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-c2znj\"" Jun 10 12:56:17.017479 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.017458 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-bwzm5"] Jun 10 12:56:17.051864 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.051842 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa-bound-sa-token\") pod \"cert-manager-59c77684cc-bwzm5\" (UID: \"0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa\") " pod="cert-manager/cert-manager-59c77684cc-bwzm5" Jun 10 12:56:17.051994 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.051901 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p9v5\" (UniqueName: \"kubernetes.io/projected/0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa-kube-api-access-7p9v5\") pod \"cert-manager-59c77684cc-bwzm5\" (UID: \"0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa\") " pod="cert-manager/cert-manager-59c77684cc-bwzm5" Jun 10 12:56:17.153128 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.153104 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa-bound-sa-token\") pod \"cert-manager-59c77684cc-bwzm5\" (UID: \"0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa\") " pod="cert-manager/cert-manager-59c77684cc-bwzm5" Jun 10 12:56:17.153240 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.153138 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p9v5\" (UniqueName: \"kubernetes.io/projected/0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa-kube-api-access-7p9v5\") pod \"cert-manager-59c77684cc-bwzm5\" (UID: \"0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa\") " pod="cert-manager/cert-manager-59c77684cc-bwzm5" Jun 10 12:56:17.173918 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.173893 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p9v5\" (UniqueName: \"kubernetes.io/projected/0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa-kube-api-access-7p9v5\") pod \"cert-manager-59c77684cc-bwzm5\" (UID: \"0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa\") " pod="cert-manager/cert-manager-59c77684cc-bwzm5" Jun 10 12:56:17.175043 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.175027 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa-bound-sa-token\") pod \"cert-manager-59c77684cc-bwzm5\" (UID: \"0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa\") " pod="cert-manager/cert-manager-59c77684cc-bwzm5" Jun 10 12:56:17.309302 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.309234 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-bwzm5" Jun 10 12:56:17.430433 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.430374 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-bwzm5"] Jun 10 12:56:17.432583 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:56:17.432548 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b3bbf3c_d1e0_4579_9b17_2fb7c26518fa.slice/crio-839fce0e0dee6e1715fee864eedfe98c039d0ae72cab6a646c19234dfac35f8b WatchSource:0}: Error finding container 839fce0e0dee6e1715fee864eedfe98c039d0ae72cab6a646c19234dfac35f8b: Status 404 returned error can't find the container with id 839fce0e0dee6e1715fee864eedfe98c039d0ae72cab6a646c19234dfac35f8b Jun 10 12:56:17.864260 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.864227 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-bwzm5" event={"ID":"0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa","Type":"ContainerStarted","Data":"7037c6b2125ebfd5f8bd42cf1a27d3f22462e08b77029be8cecc37629c2237d9"} Jun 10 12:56:17.864260 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.864262 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-bwzm5" event={"ID":"0b3bbf3c-d1e0-4579-9b17-2fb7c26518fa","Type":"ContainerStarted","Data":"839fce0e0dee6e1715fee864eedfe98c039d0ae72cab6a646c19234dfac35f8b"} Jun 10 12:56:17.882402 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:17.882358 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-bwzm5" podStartSLOduration=1.882342943 podStartE2EDuration="1.882342943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:56:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:56:17.88091498 +0000 UTC m=+492.433439759" watchObservedRunningTime="2026-06-10 12:56:17.882342943 +0000 UTC m=+492.434867722" Jun 10 12:56:24.362311 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:24.362254 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:24.469043 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:24.469012 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:26.152483 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:26.152448 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:41.321017 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:41.320983 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:41.423941 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:41.423915 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:41.885542 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:41.885509 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:42.290610 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.290533 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:42.390804 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.390773 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:42.430729 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.430696 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54"] Jun 10 12:56:42.436286 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.436269 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.439086 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.439069 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 12:56:42.439379 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.439361 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 12:56:42.439379 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.439371 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vckhl\"" Jun 10 12:56:42.439536 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.439451 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 12:56:42.439592 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.439582 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 12:56:42.451542 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.451522 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54"] Jun 10 12:56:42.547696 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.547624 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/022b9560-320e-42a0-af5d-bfc12930cd47-tmp\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.547696 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.547657 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/022b9560-320e-42a0-af5d-bfc12930cd47-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.547696 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.547676 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26w7l\" (UniqueName: \"kubernetes.io/projected/022b9560-320e-42a0-af5d-bfc12930cd47-kube-api-access-26w7l\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.547909 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.547702 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/022b9560-320e-42a0-af5d-bfc12930cd47-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.547909 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.547743 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/022b9560-320e-42a0-af5d-bfc12930cd47-manifests\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.560238 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.560213 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:42.648769 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.648745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/022b9560-320e-42a0-af5d-bfc12930cd47-tmp\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.648909 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.648775 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/022b9560-320e-42a0-af5d-bfc12930cd47-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.648909 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.648795 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26w7l\" (UniqueName: \"kubernetes.io/projected/022b9560-320e-42a0-af5d-bfc12930cd47-kube-api-access-26w7l\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.648909 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.648815 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/022b9560-320e-42a0-af5d-bfc12930cd47-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.648909 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.648844 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/022b9560-320e-42a0-af5d-bfc12930cd47-manifests\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.649317 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.649286 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/022b9560-320e-42a0-af5d-bfc12930cd47-manifests\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.651096 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.651076 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/022b9560-320e-42a0-af5d-bfc12930cd47-tmp\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.651191 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.651172 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/022b9560-320e-42a0-af5d-bfc12930cd47-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.651191 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.651180 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/022b9560-320e-42a0-af5d-bfc12930cd47-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.661334 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.661311 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26w7l\" (UniqueName: \"kubernetes.io/projected/022b9560-320e-42a0-af5d-bfc12930cd47-kube-api-access-26w7l\") pod \"opendatahub-operator-controller-manager-7f4c98d49d-tpb54\" (UID: \"022b9560-320e-42a0-af5d-bfc12930cd47\") " pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.662038 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.662020 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:42.747949 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.747906 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:42.762946 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.762919 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:42.857048 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.857020 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:42.877470 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.877017 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54"] Jun 10 12:56:42.879348 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:56:42.879321 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022b9560_320e_42a0_af5d_bfc12930cd47.slice/crio-6468c04dfe7bee41c93a57c66198495c31299d270e0c06db53e06fbfc552434f WatchSource:0}: Error finding container 6468c04dfe7bee41c93a57c66198495c31299d270e0c06db53e06fbfc552434f: Status 404 returned error can't find the container with id 6468c04dfe7bee41c93a57c66198495c31299d270e0c06db53e06fbfc552434f Jun 10 12:56:42.936337 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.936312 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:42.965801 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:42.965776 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" event={"ID":"022b9560-320e-42a0-af5d-bfc12930cd47","Type":"ContainerStarted","Data":"6468c04dfe7bee41c93a57c66198495c31299d270e0c06db53e06fbfc552434f"} Jun 10 12:56:43.049840 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:43.049814 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:45.981345 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:45.981261 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" event={"ID":"022b9560-320e-42a0-af5d-bfc12930cd47","Type":"ContainerStarted","Data":"1a19d686612a3adb8c1551e4647240b78aa70669d894e40637a098ed11258672"} Jun 10 12:56:46.986853 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:46.986771 2570 generic.go:356] "Generic (PLEG): container finished" podID="022b9560-320e-42a0-af5d-bfc12930cd47" containerID="1a19d686612a3adb8c1551e4647240b78aa70669d894e40637a098ed11258672" exitCode=0 Jun 10 12:56:46.987264 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:46.986858 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" event={"ID":"022b9560-320e-42a0-af5d-bfc12930cd47","Type":"ContainerDied","Data":"1a19d686612a3adb8c1551e4647240b78aa70669d894e40637a098ed11258672"} Jun 10 12:56:47.993449 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:47.993408 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" event={"ID":"022b9560-320e-42a0-af5d-bfc12930cd47","Type":"ContainerStarted","Data":"281e561f6164ff1d16063cd7a328a780bf74061f22e53452049689eb065b654f"} Jun 10 12:56:47.993918 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:47.993481 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:56:48.016872 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:48.016822 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" podStartSLOduration=1.8947114269999998 podStartE2EDuration="6.016805265s" totalImagesPullingTime="3.170017424s" totalInitContainerRuntime="952.076414ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:56:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:56:48.014839971 +0000 UTC m=+522.567364753" watchObservedRunningTime="2026-06-10 12:56:48.016805265 +0000 UTC m=+522.569330043" Jun 10 12:56:48.443424 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:48.443395 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:48.559416 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:48.559380 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:56:59.000491 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:56:59.000412 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f4c98d49d-tpb54" Jun 10 12:57:00.453610 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:00.453576 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:00.684412 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:00.684377 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:01.725524 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:01.725489 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:01.865926 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:01.865888 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:02.844800 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:02.844770 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:02.938806 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:02.938758 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:03.042955 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.042924 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:03.158116 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.158037 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:03.275249 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.275222 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:03.378428 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.378401 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:03.531835 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.531761 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb"] Jun 10 12:57:03.536106 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.536087 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.539840 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.539817 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 12:57:03.540311 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.540288 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 12:57:03.540409 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.540350 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 12:57:03.540686 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.540671 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4ckmj\"" Jun 10 12:57:03.541013 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.540997 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 12:57:03.560487 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.560460 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:03.566297 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.566274 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb"] Jun 10 12:57:03.601453 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.601430 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmc6f\" (UniqueName: \"kubernetes.io/projected/a00be2a1-78e9-4cc0-a816-b299ab633734-kube-api-access-hmc6f\") pod \"kube-auth-proxy-5796c65c65-4h2tb\" (UID: \"a00be2a1-78e9-4cc0-a816-b299ab633734\") " pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.601554 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.601484 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a00be2a1-78e9-4cc0-a816-b299ab633734-tls-certs\") pod \"kube-auth-proxy-5796c65c65-4h2tb\" (UID: \"a00be2a1-78e9-4cc0-a816-b299ab633734\") " pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.601554 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.601506 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a00be2a1-78e9-4cc0-a816-b299ab633734-tmp\") pod \"kube-auth-proxy-5796c65c65-4h2tb\" (UID: \"a00be2a1-78e9-4cc0-a816-b299ab633734\") " pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.702721 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.702685 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmc6f\" (UniqueName: \"kubernetes.io/projected/a00be2a1-78e9-4cc0-a816-b299ab633734-kube-api-access-hmc6f\") pod \"kube-auth-proxy-5796c65c65-4h2tb\" (UID: \"a00be2a1-78e9-4cc0-a816-b299ab633734\") " pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.702898 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.702772 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a00be2a1-78e9-4cc0-a816-b299ab633734-tls-certs\") pod \"kube-auth-proxy-5796c65c65-4h2tb\" (UID: \"a00be2a1-78e9-4cc0-a816-b299ab633734\") " pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.702898 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.702792 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a00be2a1-78e9-4cc0-a816-b299ab633734-tmp\") pod \"kube-auth-proxy-5796c65c65-4h2tb\" (UID: \"a00be2a1-78e9-4cc0-a816-b299ab633734\") " pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.704965 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.704935 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a00be2a1-78e9-4cc0-a816-b299ab633734-tmp\") pod \"kube-auth-proxy-5796c65c65-4h2tb\" (UID: \"a00be2a1-78e9-4cc0-a816-b299ab633734\") " pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.705453 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.705435 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a00be2a1-78e9-4cc0-a816-b299ab633734-tls-certs\") pod \"kube-auth-proxy-5796c65c65-4h2tb\" (UID: \"a00be2a1-78e9-4cc0-a816-b299ab633734\") " pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.718685 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.718665 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmc6f\" (UniqueName: \"kubernetes.io/projected/a00be2a1-78e9-4cc0-a816-b299ab633734-kube-api-access-hmc6f\") pod \"kube-auth-proxy-5796c65c65-4h2tb\" (UID: \"a00be2a1-78e9-4cc0-a816-b299ab633734\") " pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.746210 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.746164 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:03.846132 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.846101 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" Jun 10 12:57:03.996829 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:03.996803 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb"] Jun 10 12:57:03.999207 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:57:03.999177 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00be2a1_78e9_4cc0_a816_b299ab633734.slice/crio-c64b03d4e41298158f3dd739195c0fa45e7a7032447d9c4d02ba90fab6db8a8b WatchSource:0}: Error finding container c64b03d4e41298158f3dd739195c0fa45e7a7032447d9c4d02ba90fab6db8a8b: Status 404 returned error can't find the container with id c64b03d4e41298158f3dd739195c0fa45e7a7032447d9c4d02ba90fab6db8a8b Jun 10 12:57:04.060997 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:04.060946 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" event={"ID":"a00be2a1-78e9-4cc0-a816-b299ab633734","Type":"ContainerStarted","Data":"c64b03d4e41298158f3dd739195c0fa45e7a7032447d9c4d02ba90fab6db8a8b"} Jun 10 12:57:04.242148 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:04.242039 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:06.799285 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:06.799267 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 12:57:07.079699 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:07.079617 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" event={"ID":"a00be2a1-78e9-4cc0-a816-b299ab633734","Type":"ContainerStarted","Data":"f33e5495f4db665a524db9a35dd37eb7ab126d3baea50616895bc372746fc63b"} Jun 10 12:57:07.098488 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:07.098446 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5796c65c65-4h2tb" podStartSLOduration=1.3030204859999999 podStartE2EDuration="4.098432647s" totalImagesPullingTime="2.795412161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:57:07.096721277 +0000 UTC m=+541.649246055" watchObservedRunningTime="2026-06-10 12:57:07.098432647 +0000 UTC m=+541.650957426" Jun 10 12:57:13.533765 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.533728 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:13.633378 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.633349 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-45td2"] Jun 10 12:57:13.635286 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.635259 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:13.636690 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.636666 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" Jun 10 12:57:13.638570 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.638549 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg"] Jun 10 12:57:13.639565 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.639551 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-75sjz\"" Jun 10 12:57:13.640360 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.640346 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 10 12:57:13.641453 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.641430 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:13.645151 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.645123 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-h8478\"" Jun 10 12:57:13.645151 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.645138 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 12:57:13.650517 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.650493 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-45td2"] Jun 10 12:57:13.656244 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.656225 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg"] Jun 10 12:57:13.689604 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.689574 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f90d8770-0888-4925-8368-28108e88bb81-cert\") pod \"kserve-controller-manager-69fc866d76-45td2\" (UID: \"f90d8770-0888-4925-8368-28108e88bb81\") " pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" Jun 10 12:57:13.689604 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.689604 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79dcf6e9-6af0-4e99-8bd0-c6a508161302-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-f5vxg\" (UID: \"79dcf6e9-6af0-4e99-8bd0-c6a508161302\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:13.689729 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.689632 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7vrt\" (UniqueName: \"kubernetes.io/projected/79dcf6e9-6af0-4e99-8bd0-c6a508161302-kube-api-access-f7vrt\") pod \"llmisvc-controller-manager-864bfd7bc9-f5vxg\" (UID: \"79dcf6e9-6af0-4e99-8bd0-c6a508161302\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:13.689729 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.689694 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc56t\" (UniqueName: \"kubernetes.io/projected/f90d8770-0888-4925-8368-28108e88bb81-kube-api-access-dc56t\") pod \"kserve-controller-manager-69fc866d76-45td2\" (UID: \"f90d8770-0888-4925-8368-28108e88bb81\") " pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" Jun 10 12:57:13.707802 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.707779 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:13.790996 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.790946 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc56t\" (UniqueName: \"kubernetes.io/projected/f90d8770-0888-4925-8368-28108e88bb81-kube-api-access-dc56t\") pod \"kserve-controller-manager-69fc866d76-45td2\" (UID: \"f90d8770-0888-4925-8368-28108e88bb81\") " pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" Jun 10 12:57:13.791099 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.790998 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f90d8770-0888-4925-8368-28108e88bb81-cert\") pod \"kserve-controller-manager-69fc866d76-45td2\" (UID: \"f90d8770-0888-4925-8368-28108e88bb81\") " pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" Jun 10 12:57:13.791099 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.791017 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79dcf6e9-6af0-4e99-8bd0-c6a508161302-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-f5vxg\" (UID: \"79dcf6e9-6af0-4e99-8bd0-c6a508161302\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:13.791099 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.791049 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7vrt\" (UniqueName: \"kubernetes.io/projected/79dcf6e9-6af0-4e99-8bd0-c6a508161302-kube-api-access-f7vrt\") pod \"llmisvc-controller-manager-864bfd7bc9-f5vxg\" (UID: \"79dcf6e9-6af0-4e99-8bd0-c6a508161302\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:13.791257 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:57:13.791152 2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 10 12:57:13.791257 ip-10-0-140-135 kubenswrapper[2570]: E0610 12:57:13.791201 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79dcf6e9-6af0-4e99-8bd0-c6a508161302-cert podName:79dcf6e9-6af0-4e99-8bd0-c6a508161302 nodeName:}" failed. No retries permitted until 2026-06-10 12:57:14.291187452 +0000 UTC m=+548.843712209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/79dcf6e9-6af0-4e99-8bd0-c6a508161302-cert") pod "llmisvc-controller-manager-864bfd7bc9-f5vxg" (UID: "79dcf6e9-6af0-4e99-8bd0-c6a508161302") : secret "llmisvc-webhook-server-cert" not found Jun 10 12:57:13.793374 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.793353 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f90d8770-0888-4925-8368-28108e88bb81-cert\") pod \"kserve-controller-manager-69fc866d76-45td2\" (UID: \"f90d8770-0888-4925-8368-28108e88bb81\") " pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" Jun 10 12:57:13.803931 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.803899 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7vrt\" (UniqueName: \"kubernetes.io/projected/79dcf6e9-6af0-4e99-8bd0-c6a508161302-kube-api-access-f7vrt\") pod \"llmisvc-controller-manager-864bfd7bc9-f5vxg\" (UID: \"79dcf6e9-6af0-4e99-8bd0-c6a508161302\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:13.804013 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.803952 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc56t\" (UniqueName: \"kubernetes.io/projected/f90d8770-0888-4925-8368-28108e88bb81-kube-api-access-dc56t\") pod \"kserve-controller-manager-69fc866d76-45td2\" (UID: \"f90d8770-0888-4925-8368-28108e88bb81\") " pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" Jun 10 12:57:13.948608 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.948572 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" Jun 10 12:57:13.977583 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:13.977550 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:14.128700 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:14.128633 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-45td2"] Jun 10 12:57:14.131029 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:57:14.131000 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf90d8770_0888_4925_8368_28108e88bb81.slice/crio-eb2cda60d7b3bdae9050dd876a4d06d8e04deb59c67790b0375309d423f53b7b WatchSource:0}: Error finding container eb2cda60d7b3bdae9050dd876a4d06d8e04deb59c67790b0375309d423f53b7b: Status 404 returned error can't find the container with id eb2cda60d7b3bdae9050dd876a4d06d8e04deb59c67790b0375309d423f53b7b Jun 10 12:57:14.296181 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:14.296116 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79dcf6e9-6af0-4e99-8bd0-c6a508161302-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-f5vxg\" (UID: \"79dcf6e9-6af0-4e99-8bd0-c6a508161302\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:14.298193 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:14.298166 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/79dcf6e9-6af0-4e99-8bd0-c6a508161302-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-f5vxg\" (UID: \"79dcf6e9-6af0-4e99-8bd0-c6a508161302\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:14.554125 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:14.554036 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:14.700421 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:14.700396 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg"] Jun 10 12:57:14.702003 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:57:14.701981 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod79dcf6e9_6af0_4e99_8bd0_c6a508161302.slice/crio-2dbd7628ebfa1404e5234c1d0195164e23f3d1dee3542b7d2ee547756c8ac2d3 WatchSource:0}: Error finding container 2dbd7628ebfa1404e5234c1d0195164e23f3d1dee3542b7d2ee547756c8ac2d3: Status 404 returned error can't find the container with id 2dbd7628ebfa1404e5234c1d0195164e23f3d1dee3542b7d2ee547756c8ac2d3 Jun 10 12:57:14.974226 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:14.974191 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:15.067669 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:15.067637 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:15.121433 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:15.121397 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" event={"ID":"f90d8770-0888-4925-8368-28108e88bb81","Type":"ContainerStarted","Data":"eb2cda60d7b3bdae9050dd876a4d06d8e04deb59c67790b0375309d423f53b7b"} Jun 10 12:57:15.122731 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:15.122693 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" event={"ID":"79dcf6e9-6af0-4e99-8bd0-c6a508161302","Type":"ContainerStarted","Data":"2dbd7628ebfa1404e5234c1d0195164e23f3d1dee3542b7d2ee547756c8ac2d3"} Jun 10 12:57:15.139910 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:15.139871 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:17.935068 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:17.935033 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:18.043827 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:18.043795 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:18.141074 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:18.141040 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" event={"ID":"f90d8770-0888-4925-8368-28108e88bb81","Type":"ContainerStarted","Data":"82ce152d1eecfef4fde626eee1c695cf0bf10326257cbc08b4d808375090a815"} Jun 10 12:57:18.141232 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:18.141126 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" Jun 10 12:57:18.142442 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:18.142423 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" event={"ID":"79dcf6e9-6af0-4e99-8bd0-c6a508161302","Type":"ContainerStarted","Data":"30f58be00105c1d734256c2478b3c28dd1ebb3224d7621080bf1243dc183b48d"} Jun 10 12:57:18.142569 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:18.142501 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:18.161934 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:18.161894 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" podStartSLOduration=1.841515803 podStartE2EDuration="5.161867835s" totalImagesPullingTime="3.320352032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:57:18.159590954 +0000 UTC m=+552.712115735" watchObservedRunningTime="2026-06-10 12:57:18.161867835 +0000 UTC m=+552.714392614" Jun 10 12:57:18.187555 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:18.187479 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" podStartSLOduration=2.434350313 podStartE2EDuration="5.187465236s" totalImagesPullingTime="2.753114923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:57:18.185363688 +0000 UTC m=+552.737888466" watchObservedRunningTime="2026-06-10 12:57:18.187465236 +0000 UTC m=+552.739990055" Jun 10 12:57:19.774334 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:19.774300 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:19.991040 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:19.991002 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:20.203810 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:20.203772 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:20.574551 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:20.574463 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:20.674894 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:20.674859 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:21.834405 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:21.834370 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn"] Jun 10 12:57:21.837680 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:21.837656 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" Jun 10 12:57:21.841030 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:21.841010 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 10 12:57:21.842076 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:21.842058 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 10 12:57:21.844200 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:21.844096 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-8cm27\"" Jun 10 12:57:21.859370 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:21.859345 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn"] Jun 10 12:57:21.962837 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:21.962808 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/db034663-8d53-4a3c-9c4b-012a2e46886e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-4z7kn\" (UID: \"db034663-8d53-4a3c-9c4b-012a2e46886e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" Jun 10 12:57:21.962837 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:21.962838 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clxnr\" (UniqueName: \"kubernetes.io/projected/db034663-8d53-4a3c-9c4b-012a2e46886e-kube-api-access-clxnr\") pod \"servicemesh-operator3-57f65f65fb-4z7kn\" (UID: \"db034663-8d53-4a3c-9c4b-012a2e46886e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" Jun 10 12:57:22.064149 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:22.064115 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/db034663-8d53-4a3c-9c4b-012a2e46886e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-4z7kn\" (UID: \"db034663-8d53-4a3c-9c4b-012a2e46886e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" Jun 10 12:57:22.064149 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:22.064151 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxnr\" (UniqueName: \"kubernetes.io/projected/db034663-8d53-4a3c-9c4b-012a2e46886e-kube-api-access-clxnr\") pod \"servicemesh-operator3-57f65f65fb-4z7kn\" (UID: \"db034663-8d53-4a3c-9c4b-012a2e46886e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" Jun 10 12:57:22.066547 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:22.066519 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/db034663-8d53-4a3c-9c4b-012a2e46886e-operator-config\") pod \"servicemesh-operator3-57f65f65fb-4z7kn\" (UID: \"db034663-8d53-4a3c-9c4b-012a2e46886e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" Jun 10 12:57:22.084598 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:22.084542 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clxnr\" (UniqueName: \"kubernetes.io/projected/db034663-8d53-4a3c-9c4b-012a2e46886e-kube-api-access-clxnr\") pod \"servicemesh-operator3-57f65f65fb-4z7kn\" (UID: \"db034663-8d53-4a3c-9c4b-012a2e46886e\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" Jun 10 12:57:22.146509 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:22.146483 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" Jun 10 12:57:22.289349 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:22.289315 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn"] Jun 10 12:57:22.292690 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:57:22.292665 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb034663_8d53_4a3c_9c4b_012a2e46886e.slice/crio-5f82752c42dac5885591fa3cf9022256554ab49ae857bec18897210c765d9f14 WatchSource:0}: Error finding container 5f82752c42dac5885591fa3cf9022256554ab49ae857bec18897210c765d9f14: Status 404 returned error can't find the container with id 5f82752c42dac5885591fa3cf9022256554ab49ae857bec18897210c765d9f14 Jun 10 12:57:23.169939 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:23.169903 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" event={"ID":"db034663-8d53-4a3c-9c4b-012a2e46886e","Type":"ContainerStarted","Data":"5f82752c42dac5885591fa3cf9022256554ab49ae857bec18897210c765d9f14"} Jun 10 12:57:26.187769 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:26.187732 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" event={"ID":"db034663-8d53-4a3c-9c4b-012a2e46886e","Type":"ContainerStarted","Data":"0a35a6a1a6ebb4a266682c11efc070db94586d7b4a866b32589437dd79bac8ce"} Jun 10 12:57:26.188248 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:26.187799 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" Jun 10 12:57:26.213260 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:26.213215 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" podStartSLOduration=2.165302982 podStartE2EDuration="5.213201546s" totalImagesPullingTime="3.047898564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:57:26.210832509 +0000 UTC m=+560.763357286" watchObservedRunningTime="2026-06-10 12:57:26.213201546 +0000 UTC m=+560.765726330" Jun 10 12:57:30.774300 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:30.774260 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:30.876311 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:30.876264 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:33.597903 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.596021 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn"] Jun 10 12:57:33.601015 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.600989 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.603597 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.603493 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 10 12:57:33.603597 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.603538 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 10 12:57:33.604022 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.603988 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 10 12:57:33.604022 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.604003 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-t57kh\"" Jun 10 12:57:33.604180 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.603997 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 12:57:33.614372 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.614351 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn"] Jun 10 12:57:33.652342 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.652313 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:33.662516 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.662494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.662603 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.662525 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c164bdfb-3a70-4e53-a730-1eda10b9ecec-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.662603 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.662548 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nmm6\" (UniqueName: \"kubernetes.io/projected/c164bdfb-3a70-4e53-a730-1eda10b9ecec-kube-api-access-8nmm6\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.662678 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.662658 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.662744 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.662727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.662785 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.662772 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.662822 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.662805 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c164bdfb-3a70-4e53-a730-1eda10b9ecec-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.759594 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.759564 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:33.763764 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.763741 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.763830 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.763774 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c164bdfb-3a70-4e53-a730-1eda10b9ecec-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.763830 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.763796 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nmm6\" (UniqueName: \"kubernetes.io/projected/c164bdfb-3a70-4e53-a730-1eda10b9ecec-kube-api-access-8nmm6\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.763922 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.763842 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.763922 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.763900 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.764054 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.764025 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.764185 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.764074 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c164bdfb-3a70-4e53-a730-1eda10b9ecec-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.764555 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.764534 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.766108 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.766078 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c164bdfb-3a70-4e53-a730-1eda10b9ecec-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.766268 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.766249 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.766374 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.766358 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c164bdfb-3a70-4e53-a730-1eda10b9ecec-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.766464 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.766376 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.772420 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.772397 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c164bdfb-3a70-4e53-a730-1eda10b9ecec-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.774669 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.774622 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nmm6\" (UniqueName: \"kubernetes.io/projected/c164bdfb-3a70-4e53-a730-1eda10b9ecec-kube-api-access-8nmm6\") pod \"istiod-openshift-gateway-75c67f8887-65sdn\" (UID: \"c164bdfb-3a70-4e53-a730-1eda10b9ecec\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:33.910541 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:33.910457 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:34.047905 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:34.047867 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn"] Jun 10 12:57:34.049851 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:57:34.049820 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc164bdfb_3a70_4e53_a730_1eda10b9ecec.slice/crio-636cfab6c21057b349e94ed11f0911f69146685a9a705092ac01497cd3819bbe WatchSource:0}: Error finding container 636cfab6c21057b349e94ed11f0911f69146685a9a705092ac01497cd3819bbe: Status 404 returned error can't find the container with id 636cfab6c21057b349e94ed11f0911f69146685a9a705092ac01497cd3819bbe Jun 10 12:57:34.225105 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:34.225000 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" event={"ID":"c164bdfb-3a70-4e53-a730-1eda10b9ecec","Type":"ContainerStarted","Data":"636cfab6c21057b349e94ed11f0911f69146685a9a705092ac01497cd3819bbe"} Jun 10 12:57:34.225528 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:34.225502 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:36.630945 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:36.630906 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 12:57:36.631220 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:36.630970 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 10 12:57:37.088711 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:37.088681 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:37.195288 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:37.195250 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4z7kn" Jun 10 12:57:37.196189 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:37.196144 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:37.243330 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:37.243299 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" event={"ID":"c164bdfb-3a70-4e53-a730-1eda10b9ecec","Type":"ContainerStarted","Data":"2b7ce932352076e7516a7593cea754517d94453a9f835c158cd9818de92b356f"} Jun 10 12:57:37.243566 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:37.243520 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:37.245001 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:37.244977 2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-65sdn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 10 12:57:37.245094 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:37.245024 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" podUID="c164bdfb-3a70-4e53-a730-1eda10b9ecec" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:57:37.287594 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:37.287547 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" podStartSLOduration=1.7087816820000001 podStartE2EDuration="4.287531553s" totalImagesPullingTime="2.578749871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:57:37.285528008 +0000 UTC m=+571.838052788" watchObservedRunningTime="2026-06-10 12:57:37.287531553 +0000 UTC m=+571.840056331" Jun 10 12:57:37.484234 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:37.484162 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:37.698121 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:37.698087 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:38.249294 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:38.249265 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-65sdn" Jun 10 12:57:38.811103 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:38.810985 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:39.304499 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.304464 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8689d8b558-fz5ln"] Jun 10 12:57:39.309008 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.308987 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" Jun 10 12:57:39.312075 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.312051 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-npv95\"" Jun 10 12:57:39.312194 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.312051 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 12:57:39.321225 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.321201 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8689d8b558-fz5ln"] Jun 10 12:57:39.339238 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.339216 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:39.415916 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.415869 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/29e8fc7a-4c50-4881-884a-1b299e38b87a-redirect-config\") pod \"dashboard-redirect-8689d8b558-fz5ln\" (UID: \"29e8fc7a-4c50-4881-884a-1b299e38b87a\") " pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" Jun 10 12:57:39.416038 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.415920 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jgmp\" (UniqueName: \"kubernetes.io/projected/29e8fc7a-4c50-4881-884a-1b299e38b87a-kube-api-access-5jgmp\") pod \"dashboard-redirect-8689d8b558-fz5ln\" (UID: \"29e8fc7a-4c50-4881-884a-1b299e38b87a\") " pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" Jun 10 12:57:39.517151 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.517128 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/29e8fc7a-4c50-4881-884a-1b299e38b87a-redirect-config\") pod \"dashboard-redirect-8689d8b558-fz5ln\" (UID: \"29e8fc7a-4c50-4881-884a-1b299e38b87a\") " pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" Jun 10 12:57:39.517265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.517181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jgmp\" (UniqueName: \"kubernetes.io/projected/29e8fc7a-4c50-4881-884a-1b299e38b87a-kube-api-access-5jgmp\") pod \"dashboard-redirect-8689d8b558-fz5ln\" (UID: \"29e8fc7a-4c50-4881-884a-1b299e38b87a\") " pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" Jun 10 12:57:39.517724 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.517706 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/29e8fc7a-4c50-4881-884a-1b299e38b87a-redirect-config\") pod \"dashboard-redirect-8689d8b558-fz5ln\" (UID: \"29e8fc7a-4c50-4881-884a-1b299e38b87a\") " pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" Jun 10 12:57:39.543550 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.543525 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jgmp\" (UniqueName: \"kubernetes.io/projected/29e8fc7a-4c50-4881-884a-1b299e38b87a-kube-api-access-5jgmp\") pod \"dashboard-redirect-8689d8b558-fz5ln\" (UID: \"29e8fc7a-4c50-4881-884a-1b299e38b87a\") " pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" Jun 10 12:57:39.619326 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.619304 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" Jun 10 12:57:39.766387 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:39.766353 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8689d8b558-fz5ln"] Jun 10 12:57:39.770807 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:57:39.770780 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e8fc7a_4c50_4881_884a_1b299e38b87a.slice/crio-2ba3b245202aaff446e04d76d215d64f8a369354f169843e67641ab69a5ce181 WatchSource:0}: Error finding container 2ba3b245202aaff446e04d76d215d64f8a369354f169843e67641ab69a5ce181: Status 404 returned error can't find the container with id 2ba3b245202aaff446e04d76d215d64f8a369354f169843e67641ab69a5ce181 Jun 10 12:57:40.260004 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:40.259967 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" event={"ID":"29e8fc7a-4c50-4881-884a-1b299e38b87a","Type":"ContainerStarted","Data":"2ba3b245202aaff446e04d76d215d64f8a369354f169843e67641ab69a5ce181"} Jun 10 12:57:42.424734 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:42.424704 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:43.507805 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:43.507759 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:45.291289 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:45.291259 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" event={"ID":"29e8fc7a-4c50-4881-884a-1b299e38b87a","Type":"ContainerStarted","Data":"91d71a39267d339d44c804bff94c90a360cd8de1e1bd8a3bdf48c4ad3a57d15f"} Jun 10 12:57:45.309846 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:45.309787 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8689d8b558-fz5ln" podStartSLOduration=1.67675142 podStartE2EDuration="6.309767838s" totalImagesPullingTime="4.633016418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:57:45.308103633 +0000 UTC m=+579.860628412" watchObservedRunningTime="2026-06-10 12:57:45.309767838 +0000 UTC m=+579.862292616" Jun 10 12:57:49.150581 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:49.150550 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-f5vxg" Jun 10 12:57:49.153563 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:49.153538 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-45td2" Jun 10 12:57:58.084780 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:58.084741 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:57:58.172058 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:57:58.172017 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:03.207735 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:03.207691 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:03.305455 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:03.305419 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:03.391488 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:03.391457 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:04.145939 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:04.145910 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:04.340777 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:04.340743 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:05.902110 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:05.902086 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 12:58:05.902538 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:05.902090 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 12:58:05.906440 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:05.906421 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 12:58:05.906550 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:05.906427 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 12:58:06.130676 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:06.130639 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:06.205588 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:06.205501 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:08.193974 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:08.193945 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:08.273318 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:08.273290 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:27.863101 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:27.863012 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:30.685860 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:30.685820 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:32.633368 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:32.633335 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:33.041103 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:33.041015 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:33.695896 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:33.695855 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:33.799857 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:33.799791 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:35.057271 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.057241 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl"] Jun 10 12:58:35.060587 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.060567 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl" Jun 10 12:58:35.063401 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.063356 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 12:58:35.063779 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.063756 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 12:58:35.064284 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.064267 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tjgwl\"" Jun 10 12:58:35.082962 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.082920 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl"] Jun 10 12:58:35.198258 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.198227 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zpsz\" (UniqueName: \"kubernetes.io/projected/496246cb-e93c-4763-9c87-edeefc839f0f-kube-api-access-6zpsz\") pod \"authorino-operator-75cc8d5cb7-s8hhl\" (UID: \"496246cb-e93c-4763-9c87-edeefc839f0f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl" Jun 10 12:58:35.299480 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.299446 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zpsz\" (UniqueName: \"kubernetes.io/projected/496246cb-e93c-4763-9c87-edeefc839f0f-kube-api-access-6zpsz\") pod \"authorino-operator-75cc8d5cb7-s8hhl\" (UID: \"496246cb-e93c-4763-9c87-edeefc839f0f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl" Jun 10 12:58:35.310266 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.310212 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zpsz\" (UniqueName: \"kubernetes.io/projected/496246cb-e93c-4763-9c87-edeefc839f0f-kube-api-access-6zpsz\") pod \"authorino-operator-75cc8d5cb7-s8hhl\" (UID: \"496246cb-e93c-4763-9c87-edeefc839f0f\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl" Jun 10 12:58:35.371510 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.371480 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl" Jun 10 12:58:35.500809 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.500776 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl"] Jun 10 12:58:35.502321 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:58:35.502296 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496246cb_e93c_4763_9c87_edeefc839f0f.slice/crio-df696d00e1c91fc5156be3b75721191850c9b7d206234ce92b4a6df5c23049c8 WatchSource:0}: Error finding container df696d00e1c91fc5156be3b75721191850c9b7d206234ce92b4a6df5c23049c8: Status 404 returned error can't find the container with id df696d00e1c91fc5156be3b75721191850c9b7d206234ce92b4a6df5c23049c8 Jun 10 12:58:35.504729 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.504713 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:58:35.518562 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.518539 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl" event={"ID":"496246cb-e93c-4763-9c87-edeefc839f0f","Type":"ContainerStarted","Data":"df696d00e1c91fc5156be3b75721191850c9b7d206234ce92b4a6df5c23049c8"} Jun 10 12:58:35.607093 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:35.607063 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:36.307386 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:36.307342 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:37.814913 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:37.814811 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:38.453561 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:38.453531 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:38.535112 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:38.535080 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl" event={"ID":"496246cb-e93c-4763-9c87-edeefc839f0f","Type":"ContainerStarted","Data":"4fed249c8099076a126c8f493f734eda3b8ff19ad34e002851832b33134f6baa"} Jun 10 12:58:38.535305 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:38.535188 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl" Jun 10 12:58:38.553392 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:38.553342 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl" podStartSLOduration=1.530458514 podStartE2EDuration="3.553326935s" totalImagesPullingTime="2.022868421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:58:38.551504429 +0000 UTC m=+633.104029211" watchObservedRunningTime="2026-06-10 12:58:38.553326935 +0000 UTC m=+633.105852137" Jun 10 12:58:39.443283 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:39.443248 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5"] Jun 10 12:58:39.446631 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:39.446615 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5" Jun 10 12:58:39.449124 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:39.449101 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 12:58:39.449244 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:39.449102 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2zbff\"" Jun 10 12:58:39.457893 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:39.457855 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5"] Jun 10 12:58:39.530823 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:39.530791 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twhxs\" (UniqueName: \"kubernetes.io/projected/a26de2f4-c461-4470-84f3-7e66f863f1a9-kube-api-access-twhxs\") pod \"dns-operator-controller-manager-864dd78c4c-5qtc5\" (UID: \"a26de2f4-c461-4470-84f3-7e66f863f1a9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5" Jun 10 12:58:39.631787 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:39.631751 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twhxs\" (UniqueName: \"kubernetes.io/projected/a26de2f4-c461-4470-84f3-7e66f863f1a9-kube-api-access-twhxs\") pod \"dns-operator-controller-manager-864dd78c4c-5qtc5\" (UID: \"a26de2f4-c461-4470-84f3-7e66f863f1a9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5" Jun 10 12:58:39.647265 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:39.647241 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twhxs\" (UniqueName: \"kubernetes.io/projected/a26de2f4-c461-4470-84f3-7e66f863f1a9-kube-api-access-twhxs\") pod \"dns-operator-controller-manager-864dd78c4c-5qtc5\" (UID: \"a26de2f4-c461-4470-84f3-7e66f863f1a9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5" Jun 10 12:58:39.757543 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:39.757460 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5" Jun 10 12:58:39.889937 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:39.889915 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5"] Jun 10 12:58:39.892741 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:58:39.892711 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda26de2f4_c461_4470_84f3_7e66f863f1a9.slice/crio-a51515e9df08378ae127cf1e373e58008786d87dfbd759b02595582619c7d9e1 WatchSource:0}: Error finding container a51515e9df08378ae127cf1e373e58008786d87dfbd759b02595582619c7d9e1: Status 404 returned error can't find the container with id a51515e9df08378ae127cf1e373e58008786d87dfbd759b02595582619c7d9e1 Jun 10 12:58:40.546262 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:40.546232 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5" event={"ID":"a26de2f4-c461-4470-84f3-7e66f863f1a9","Type":"ContainerStarted","Data":"a51515e9df08378ae127cf1e373e58008786d87dfbd759b02595582619c7d9e1"} Jun 10 12:58:41.309035 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:41.309002 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:41.399080 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:41.399049 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:42.557677 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:42.557641 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5" event={"ID":"a26de2f4-c461-4470-84f3-7e66f863f1a9","Type":"ContainerStarted","Data":"3cb40ac62c7983f84a01c4a4ca0406bf69dbb29b146205d27d2db688acdb76cb"} Jun 10 12:58:42.558071 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:42.557769 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5" Jun 10 12:58:42.578726 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:42.578670 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5" podStartSLOduration=1.457029303 podStartE2EDuration="3.578652771s" totalImagesPullingTime="2.121623468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:58:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:58:42.57730187 +0000 UTC m=+637.129826640" watchObservedRunningTime="2026-06-10 12:58:42.578652771 +0000 UTC m=+637.131177550" Jun 10 12:58:43.150616 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:43.150567 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:43.263356 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:43.263304 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:49.543403 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:49.543364 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-s8hhl" Jun 10 12:58:52.078214 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:52.078171 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:52.213420 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:52.213374 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:52.686337 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:52.686289 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:52.797759 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:52.797731 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:53.565275 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:53.565247 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5qtc5" Jun 10 12:58:55.905718 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:55.905687 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:56.006956 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.006928 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:56.015557 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.015533 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb"] Jun 10 12:58:56.017914 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.017895 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 12:58:56.022193 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.022175 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hknzp\"" Jun 10 12:58:56.031412 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.031394 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb"] Jun 10 12:58:56.078714 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.078692 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0fe4160-7e2d-4204-a17d-c42df8483978-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r2kvb\" (UID: \"e0fe4160-7e2d-4204-a17d-c42df8483978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 12:58:56.078834 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.078741 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbcqr\" (UniqueName: \"kubernetes.io/projected/e0fe4160-7e2d-4204-a17d-c42df8483978-kube-api-access-qbcqr\") pod \"kuadrant-operator-controller-manager-86878c769f-r2kvb\" (UID: \"e0fe4160-7e2d-4204-a17d-c42df8483978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 12:58:56.179714 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.179650 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbcqr\" (UniqueName: \"kubernetes.io/projected/e0fe4160-7e2d-4204-a17d-c42df8483978-kube-api-access-qbcqr\") pod \"kuadrant-operator-controller-manager-86878c769f-r2kvb\" (UID: \"e0fe4160-7e2d-4204-a17d-c42df8483978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 12:58:56.179714 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.179708 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0fe4160-7e2d-4204-a17d-c42df8483978-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r2kvb\" (UID: \"e0fe4160-7e2d-4204-a17d-c42df8483978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 12:58:56.180030 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.180014 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0fe4160-7e2d-4204-a17d-c42df8483978-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r2kvb\" (UID: \"e0fe4160-7e2d-4204-a17d-c42df8483978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 12:58:56.190845 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.190821 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbcqr\" (UniqueName: \"kubernetes.io/projected/e0fe4160-7e2d-4204-a17d-c42df8483978-kube-api-access-qbcqr\") pod \"kuadrant-operator-controller-manager-86878c769f-r2kvb\" (UID: \"e0fe4160-7e2d-4204-a17d-c42df8483978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 12:58:56.328138 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.328115 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 12:58:56.420645 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.420619 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:56.460374 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.460307 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb"] Jun 10 12:58:56.463269 ip-10-0-140-135 kubenswrapper[2570]: W0610 12:58:56.463233 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fe4160_7e2d_4204_a17d_c42df8483978.slice/crio-2d0fe5e4c4d59d02108c45fa4b850a5fde7ebaa4daeb6d8857505e397c0f23be WatchSource:0}: Error finding container 2d0fe5e4c4d59d02108c45fa4b850a5fde7ebaa4daeb6d8857505e397c0f23be: Status 404 returned error can't find the container with id 2d0fe5e4c4d59d02108c45fa4b850a5fde7ebaa4daeb6d8857505e397c0f23be Jun 10 12:58:56.532009 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.531981 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:56.624611 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:56.624584 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" event={"ID":"e0fe4160-7e2d-4204-a17d-c42df8483978","Type":"ContainerStarted","Data":"2d0fe5e4c4d59d02108c45fa4b850a5fde7ebaa4daeb6d8857505e397c0f23be"} Jun 10 12:58:59.420572 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:59.420523 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:58:59.515067 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:58:59.515033 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:01.651733 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:01.651647 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" event={"ID":"e0fe4160-7e2d-4204-a17d-c42df8483978","Type":"ContainerStarted","Data":"0349984572dbb2ab292e6975c0398ec6336d90a350a07b5666ef12ee530b3af1"} Jun 10 12:59:01.651733 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:01.651718 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 12:59:01.673348 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:01.673297 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" podStartSLOduration=1.7387118419999998 podStartE2EDuration="6.673279192s" totalImagesPullingTime="4.93456735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:59:01.672219537 +0000 UTC m=+656.224744322" watchObservedRunningTime="2026-06-10 12:59:01.673279192 +0000 UTC m=+656.225803971" Jun 10 12:59:05.279596 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:05.279563 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:05.353323 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:05.353286 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:12.658996 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:12.658968 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 12:59:14.628058 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:14.628019 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:14.729427 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:14.729389 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:14.829440 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:14.829403 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:16.934025 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:16.933992 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:17.622766 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:17.622715 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:17.721931 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:17.721872 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:20.117638 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:20.117602 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:20.216655 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:20.216620 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:29.021898 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:29.021845 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:29.081157 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:29.081119 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:32.656346 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:32.656295 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:33.129143 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:33.129107 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:33.249014 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:33.248985 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:33.321903 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:33.321856 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:34.084760 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:34.084720 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:34.161005 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:34.160968 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:37.736910 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:37.736864 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:54.236513 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:54.236433 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:54.349574 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:54.349542 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:54.724762 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:54.724729 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:56.370493 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:56.370458 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 12:59:56.470450 ip-10-0-140-135 kubenswrapper[2570]: I0610 12:59:56.470416 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:00:05.009522 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:05.009486 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:00:05.111752 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:05.111720 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:00:05.245862 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:05.245834 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:00:29.442462 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.442421 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:00:29.543277 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.543246 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:00:29.848565 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.848533 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:00:29.851593 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.851578 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:00:29.854152 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.854130 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 13:00:29.854152 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.854137 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 13:00:29.854460 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.854445 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 13:00:29.855158 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.855145 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nfkqk\"" Jun 10 13:00:29.863714 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.863694 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:00:29.865401 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.865382 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr8gn\" (UniqueName: \"kubernetes.io/projected/23686b15-2e2f-4535-ab95-f2041611897c-kube-api-access-xr8gn\") pod \"maas-keycloak-0\" (UID: \"23686b15-2e2f-4535-ab95-f2041611897c\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:00:29.966569 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.966537 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr8gn\" (UniqueName: \"kubernetes.io/projected/23686b15-2e2f-4535-ab95-f2041611897c-kube-api-access-xr8gn\") pod \"maas-keycloak-0\" (UID: \"23686b15-2e2f-4535-ab95-f2041611897c\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:00:29.978150 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:29.978122 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr8gn\" (UniqueName: \"kubernetes.io/projected/23686b15-2e2f-4535-ab95-f2041611897c-kube-api-access-xr8gn\") pod \"maas-keycloak-0\" (UID: \"23686b15-2e2f-4535-ab95-f2041611897c\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:00:30.161821 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:30.161744 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:00:30.292993 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:30.292967 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:00:30.294807 ip-10-0-140-135 kubenswrapper[2570]: W0610 13:00:30.294781 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23686b15_2e2f_4535_ab95_f2041611897c.slice/crio-e6ef8c90e83f47ffda025d942931332765a05ac9309de97005062ccc7fd2b252 WatchSource:0}: Error finding container e6ef8c90e83f47ffda025d942931332765a05ac9309de97005062ccc7fd2b252: Status 404 returned error can't find the container with id e6ef8c90e83f47ffda025d942931332765a05ac9309de97005062ccc7fd2b252 Jun 10 13:00:31.088352 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:31.088261 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"23686b15-2e2f-4535-ab95-f2041611897c","Type":"ContainerStarted","Data":"e6ef8c90e83f47ffda025d942931332765a05ac9309de97005062ccc7fd2b252"} Jun 10 13:00:34.287286 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:34.287257 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:00:34.367056 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:34.367021 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:00:36.121242 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:36.121206 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"23686b15-2e2f-4535-ab95-f2041611897c","Type":"ContainerStarted","Data":"2ef317e77926ad28d6ca0f194929c807bd0bc3d5a66f1cc25a5dc6932a58685c"} Jun 10 13:00:36.162030 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:36.161994 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 13:00:36.163263 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:36.163228 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:37.162677 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:37.162622 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:38.162664 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:38.162618 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:39.162414 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:39.162361 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:40.162341 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:40.162310 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:00:40.162706 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:40.162660 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:41.163013 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:41.162960 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:42.162729 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:42.162673 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:43.162767 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:43.162715 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:44.162920 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:44.162863 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:45.163216 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:45.163159 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:46.162919 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:46.162849 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:47.162441 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:47.162372 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:48.162449 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:48.162403 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.34:9000/health/started\": dial tcp 10.134.0.34:9000: connect: connection refused" Jun 10 13:00:49.289020 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:49.288982 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 13:00:49.306852 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:49.306804 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:00:49.313344 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:49.313264 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=15.382559544 podStartE2EDuration="20.313242817s" totalImagesPullingTime="4.930683273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:00:36.162635077 +0000 UTC m=+750.715159857" watchObservedRunningTime="2026-06-10 13:00:49.313242817 +0000 UTC m=+763.865767616" Jun 10 13:00:57.846597 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:57.846555 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:00:59.294923 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:59.294895 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:00:59.949338 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:00:59.949303 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:00.059610 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:00.059574 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:06.581999 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.581963 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:06.593969 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.593935 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6dd6578446-7pc8b"] Jun 10 13:01:06.600722 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.600697 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:06.603114 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.603092 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 13:01:06.603219 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.603139 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9xrt9\"" Jun 10 13:01:06.603219 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.603172 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 13:01:06.608829 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.608394 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dd6578446-7pc8b"] Jun 10 13:01:06.678657 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.678627 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:06.718583 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.718546 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-webhook-cert\") pod \"maas-controller-6dd6578446-7pc8b\" (UID: \"ba1a5f27-32da-4dd7-bc90-6f6fff42b298\") " pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:06.718583 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.718582 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jshq2\" (UniqueName: \"kubernetes.io/projected/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-kube-api-access-jshq2\") pod \"maas-controller-6dd6578446-7pc8b\" (UID: \"ba1a5f27-32da-4dd7-bc90-6f6fff42b298\") " pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:06.748962 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.748930 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:06.749675 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.749655 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dbc685b49-nq5nq"] Jun 10 13:01:06.754701 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.754671 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:01:06.768554 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.768525 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dbc685b49-nq5nq"] Jun 10 13:01:06.816046 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.816012 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:06.819085 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.819064 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-webhook-cert\") pod \"maas-controller-6dd6578446-7pc8b\" (UID: \"ba1a5f27-32da-4dd7-bc90-6f6fff42b298\") " pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:06.819168 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.819095 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jshq2\" (UniqueName: \"kubernetes.io/projected/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-kube-api-access-jshq2\") pod \"maas-controller-6dd6578446-7pc8b\" (UID: \"ba1a5f27-32da-4dd7-bc90-6f6fff42b298\") " pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:06.821486 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.821463 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-webhook-cert\") pod \"maas-controller-6dd6578446-7pc8b\" (UID: \"ba1a5f27-32da-4dd7-bc90-6f6fff42b298\") " pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:06.828700 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.828675 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jshq2\" (UniqueName: \"kubernetes.io/projected/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-kube-api-access-jshq2\") pod \"maas-controller-6dd6578446-7pc8b\" (UID: \"ba1a5f27-32da-4dd7-bc90-6f6fff42b298\") " pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:06.912615 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.912582 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:06.920083 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.920054 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhjhk\" (UniqueName: \"kubernetes.io/projected/5f8db679-227d-43db-a8a5-2dfb4c8802cb-kube-api-access-jhjhk\") pod \"maas-controller-7dbc685b49-nq5nq\" (UID: \"5f8db679-227d-43db-a8a5-2dfb4c8802cb\") " pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:01:06.920193 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:06.920152 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f8db679-227d-43db-a8a5-2dfb4c8802cb-webhook-cert\") pod \"maas-controller-7dbc685b49-nq5nq\" (UID: \"5f8db679-227d-43db-a8a5-2dfb4c8802cb\") " pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:01:07.021198 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:07.021163 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f8db679-227d-43db-a8a5-2dfb4c8802cb-webhook-cert\") pod \"maas-controller-7dbc685b49-nq5nq\" (UID: \"5f8db679-227d-43db-a8a5-2dfb4c8802cb\") " pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:01:07.021353 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:07.021237 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhjhk\" (UniqueName: \"kubernetes.io/projected/5f8db679-227d-43db-a8a5-2dfb4c8802cb-kube-api-access-jhjhk\") pod \"maas-controller-7dbc685b49-nq5nq\" (UID: \"5f8db679-227d-43db-a8a5-2dfb4c8802cb\") " pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:01:07.023654 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:07.023626 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f8db679-227d-43db-a8a5-2dfb4c8802cb-webhook-cert\") pod \"maas-controller-7dbc685b49-nq5nq\" (UID: \"5f8db679-227d-43db-a8a5-2dfb4c8802cb\") " pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:01:07.033594 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:07.033559 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhjhk\" (UniqueName: \"kubernetes.io/projected/5f8db679-227d-43db-a8a5-2dfb4c8802cb-kube-api-access-jhjhk\") pod \"maas-controller-7dbc685b49-nq5nq\" (UID: \"5f8db679-227d-43db-a8a5-2dfb4c8802cb\") " pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:01:07.053844 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:07.053823 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6dd6578446-7pc8b"] Jun 10 13:01:07.056508 ip-10-0-140-135 kubenswrapper[2570]: W0610 13:01:07.056483 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1a5f27_32da_4dd7_bc90_6f6fff42b298.slice/crio-14898f573fe5f77addc5de994c7f50214a71b2e20eabb605988c90c4c96b01e5 WatchSource:0}: Error finding container 14898f573fe5f77addc5de994c7f50214a71b2e20eabb605988c90c4c96b01e5: Status 404 returned error can't find the container with id 14898f573fe5f77addc5de994c7f50214a71b2e20eabb605988c90c4c96b01e5 Jun 10 13:01:07.066406 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:07.066384 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:01:07.195466 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:07.195444 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dbc685b49-nq5nq"] Jun 10 13:01:07.197388 ip-10-0-140-135 kubenswrapper[2570]: W0610 13:01:07.197364 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8db679_227d_43db_a8a5_2dfb4c8802cb.slice/crio-35e8ee2057989b35eb9ca16317621edc583ac743c57b680cb9927463f1430cc0 WatchSource:0}: Error finding container 35e8ee2057989b35eb9ca16317621edc583ac743c57b680cb9927463f1430cc0: Status 404 returned error can't find the container with id 35e8ee2057989b35eb9ca16317621edc583ac743c57b680cb9927463f1430cc0 Jun 10 13:01:07.317736 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:07.317697 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dd6578446-7pc8b" event={"ID":"ba1a5f27-32da-4dd7-bc90-6f6fff42b298","Type":"ContainerStarted","Data":"14898f573fe5f77addc5de994c7f50214a71b2e20eabb605988c90c4c96b01e5"} Jun 10 13:01:07.318835 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:07.318814 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" event={"ID":"5f8db679-227d-43db-a8a5-2dfb4c8802cb","Type":"ContainerStarted","Data":"35e8ee2057989b35eb9ca16317621edc583ac743c57b680cb9927463f1430cc0"} Jun 10 13:01:09.924687 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:09.924588 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:10.040357 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:10.040324 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:10.338761 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:10.338722 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dd6578446-7pc8b" event={"ID":"ba1a5f27-32da-4dd7-bc90-6f6fff42b298","Type":"ContainerStarted","Data":"a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9"} Jun 10 13:01:10.339053 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:10.338792 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:10.340476 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:10.340443 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" event={"ID":"5f8db679-227d-43db-a8a5-2dfb4c8802cb","Type":"ContainerStarted","Data":"3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8"} Jun 10 13:01:10.340595 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:10.340505 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:01:10.355770 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:10.355715 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6dd6578446-7pc8b" podStartSLOduration=1.7332625579999998 podStartE2EDuration="4.355698013s" totalImagesPullingTime="2.622435455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:10.355016145 +0000 UTC m=+784.907540925" watchObservedRunningTime="2026-06-10 13:01:10.355698013 +0000 UTC m=+784.908222796" Jun 10 13:01:10.373523 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:10.373468 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" podStartSLOduration=1.9012635869999999 podStartE2EDuration="4.373452344s" totalImagesPullingTime="2.472188757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:10.371504502 +0000 UTC m=+784.924029280" watchObservedRunningTime="2026-06-10 13:01:10.373452344 +0000 UTC m=+784.925977147" Jun 10 13:01:21.353446 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.353408 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:21.353956 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.353495 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:01:21.414909 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.414860 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dd6578446-7pc8b"] Jun 10 13:01:21.415116 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.415092 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6dd6578446-7pc8b" podUID="ba1a5f27-32da-4dd7-bc90-6f6fff42b298" containerName="manager" containerID="cri-o://a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9" gracePeriod=30 Jun 10 13:01:21.666662 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.666636 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:21.746960 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.746926 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jshq2\" (UniqueName: \"kubernetes.io/projected/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-kube-api-access-jshq2\") pod \"ba1a5f27-32da-4dd7-bc90-6f6fff42b298\" (UID: \"ba1a5f27-32da-4dd7-bc90-6f6fff42b298\") " Jun 10 13:01:21.747144 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.746977 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-webhook-cert\") pod \"ba1a5f27-32da-4dd7-bc90-6f6fff42b298\" (UID: \"ba1a5f27-32da-4dd7-bc90-6f6fff42b298\") " Jun 10 13:01:21.749134 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.749105 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ba1a5f27-32da-4dd7-bc90-6f6fff42b298" (UID: "ba1a5f27-32da-4dd7-bc90-6f6fff42b298"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:01:21.749247 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.749171 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-kube-api-access-jshq2" (OuterVolumeSpecName: "kube-api-access-jshq2") pod "ba1a5f27-32da-4dd7-bc90-6f6fff42b298" (UID: "ba1a5f27-32da-4dd7-bc90-6f6fff42b298"). InnerVolumeSpecName "kube-api-access-jshq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:01:21.848136 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.848097 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jshq2\" (UniqueName: \"kubernetes.io/projected/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-kube-api-access-jshq2\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 13:01:21.848136 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:21.848129 2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba1a5f27-32da-4dd7-bc90-6f6fff42b298-webhook-cert\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 13:01:22.407934 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:22.407869 2570 generic.go:356] "Generic (PLEG): container finished" podID="ba1a5f27-32da-4dd7-bc90-6f6fff42b298" containerID="a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9" exitCode=0 Jun 10 13:01:22.408342 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:22.407938 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6dd6578446-7pc8b" Jun 10 13:01:22.408342 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:22.407981 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dd6578446-7pc8b" event={"ID":"ba1a5f27-32da-4dd7-bc90-6f6fff42b298","Type":"ContainerDied","Data":"a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9"} Jun 10 13:01:22.408342 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:22.408068 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6dd6578446-7pc8b" event={"ID":"ba1a5f27-32da-4dd7-bc90-6f6fff42b298","Type":"ContainerDied","Data":"14898f573fe5f77addc5de994c7f50214a71b2e20eabb605988c90c4c96b01e5"} Jun 10 13:01:22.408342 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:22.408097 2570 scope.go:117] "RemoveContainer" containerID="a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9" Jun 10 13:01:22.416833 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:22.416633 2570 scope.go:117] "RemoveContainer" containerID="a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9" Jun 10 13:01:22.416931 ip-10-0-140-135 kubenswrapper[2570]: E0610 13:01:22.416914 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9\": container with ID starting with a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9 not found: ID does not exist" containerID="a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9" Jun 10 13:01:22.416981 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:22.416938 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9"} err="failed to get container status \"a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9\": rpc error: code = NotFound desc = could not find container \"a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9\": container with ID starting with a4bcc85877f4cfee641184a61b3af3e9c69bde8098751a0084ab8e9c6ba773d9 not found: ID does not exist" Jun 10 13:01:22.425051 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:22.425028 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6dd6578446-7pc8b"] Jun 10 13:01:22.430598 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:22.430579 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6dd6578446-7pc8b"] Jun 10 13:01:23.929116 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:23.929086 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba1a5f27-32da-4dd7-bc90-6f6fff42b298" path="/var/lib/kubelet/pods/ba1a5f27-32da-4dd7-bc90-6f6fff42b298/volumes" Jun 10 13:01:41.039555 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.039517 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:41.504579 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.504549 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:41.605596 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.605565 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:41.706148 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.706115 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:01:41.734648 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.734620 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2hlsh"] Jun 10 13:01:41.735038 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.735024 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba1a5f27-32da-4dd7-bc90-6f6fff42b298" containerName="manager" Jun 10 13:01:41.735094 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.735041 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba1a5f27-32da-4dd7-bc90-6f6fff42b298" containerName="manager" Jun 10 13:01:41.735134 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.735122 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba1a5f27-32da-4dd7-bc90-6f6fff42b298" containerName="manager" Jun 10 13:01:41.737618 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.737584 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-2hlsh" Jun 10 13:01:41.740203 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.740181 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 13:01:41.740312 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.740181 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xqnpq\"" Jun 10 13:01:41.746830 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.746802 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2hlsh"] Jun 10 13:01:41.831251 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.831178 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkxl8\" (UniqueName: \"kubernetes.io/projected/f2962e7c-d302-4374-a75a-c04e4e7434c6-kube-api-access-tkxl8\") pod \"payload-processing-699b6cd6c-2hlsh\" (UID: \"f2962e7c-d302-4374-a75a-c04e4e7434c6\") " pod="openshift-ingress/payload-processing-699b6cd6c-2hlsh" Jun 10 13:01:41.931792 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.931754 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkxl8\" (UniqueName: \"kubernetes.io/projected/f2962e7c-d302-4374-a75a-c04e4e7434c6-kube-api-access-tkxl8\") pod \"payload-processing-699b6cd6c-2hlsh\" (UID: \"f2962e7c-d302-4374-a75a-c04e4e7434c6\") " pod="openshift-ingress/payload-processing-699b6cd6c-2hlsh" Jun 10 13:01:41.939957 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:41.939934 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkxl8\" (UniqueName: \"kubernetes.io/projected/f2962e7c-d302-4374-a75a-c04e4e7434c6-kube-api-access-tkxl8\") pod \"payload-processing-699b6cd6c-2hlsh\" (UID: \"f2962e7c-d302-4374-a75a-c04e4e7434c6\") " pod="openshift-ingress/payload-processing-699b6cd6c-2hlsh" Jun 10 13:01:42.048924 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:42.048863 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-2hlsh" Jun 10 13:01:42.188148 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:42.188119 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2hlsh"] Jun 10 13:01:42.190056 ip-10-0-140-135 kubenswrapper[2570]: W0610 13:01:42.190016 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2962e7c_d302_4374_a75a_c04e4e7434c6.slice/crio-34c8c4739be3afcab376b57138585019240df45d1215a3546bee976b8dbbd0ac WatchSource:0}: Error finding container 34c8c4739be3afcab376b57138585019240df45d1215a3546bee976b8dbbd0ac: Status 404 returned error can't find the container with id 34c8c4739be3afcab376b57138585019240df45d1215a3546bee976b8dbbd0ac Jun 10 13:01:42.507383 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:42.507295 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-2hlsh" event={"ID":"f2962e7c-d302-4374-a75a-c04e4e7434c6","Type":"ContainerStarted","Data":"34c8c4739be3afcab376b57138585019240df45d1215a3546bee976b8dbbd0ac"} Jun 10 13:01:44.521010 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:44.520976 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-2hlsh" event={"ID":"f2962e7c-d302-4374-a75a-c04e4e7434c6","Type":"ContainerStarted","Data":"75824360c0b6f94a8646bc102c56eefbe5071912fdcd7a2a8a585d85410bfc17"} Jun 10 13:01:44.521475 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:44.521049 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-2hlsh" Jun 10 13:01:44.539969 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:44.539922 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-2hlsh" podStartSLOduration=1.376215417 podStartE2EDuration="3.539906105s" totalImagesPullingTime="2.163690688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:44.538473703 +0000 UTC m=+819.090998485" watchObservedRunningTime="2026-06-10 13:01:44.539906105 +0000 UTC m=+819.092430882" Jun 10 13:01:54.016827 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:54.016791 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:01:54.017292 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:54.017016 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" containerID="cri-o://2ef317e77926ad28d6ca0f194929c807bd0bc3d5a66f1cc25a5dc6932a58685c" gracePeriod=30 Jun 10 13:01:55.528743 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:55.528710 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-2hlsh" Jun 10 13:01:55.576440 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:55.576410 2570 generic.go:356] "Generic (PLEG): container finished" podID="23686b15-2e2f-4535-ab95-f2041611897c" containerID="2ef317e77926ad28d6ca0f194929c807bd0bc3d5a66f1cc25a5dc6932a58685c" exitCode=143 Jun 10 13:01:55.576605 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:55.576491 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"23686b15-2e2f-4535-ab95-f2041611897c","Type":"ContainerDied","Data":"2ef317e77926ad28d6ca0f194929c807bd0bc3d5a66f1cc25a5dc6932a58685c"} Jun 10 13:01:56.062074 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.062047 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:56.162704 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.162676 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xr8gn\" (UniqueName: \"kubernetes.io/projected/23686b15-2e2f-4535-ab95-f2041611897c-kube-api-access-xr8gn\") pod \"23686b15-2e2f-4535-ab95-f2041611897c\" (UID: \"23686b15-2e2f-4535-ab95-f2041611897c\") " Jun 10 13:01:56.164809 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.164778 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23686b15-2e2f-4535-ab95-f2041611897c-kube-api-access-xr8gn" (OuterVolumeSpecName: "kube-api-access-xr8gn") pod "23686b15-2e2f-4535-ab95-f2041611897c" (UID: "23686b15-2e2f-4535-ab95-f2041611897c"). InnerVolumeSpecName "kube-api-access-xr8gn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:01:56.264123 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.264031 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xr8gn\" (UniqueName: \"kubernetes.io/projected/23686b15-2e2f-4535-ab95-f2041611897c-kube-api-access-xr8gn\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 13:01:56.583187 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.583103 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"23686b15-2e2f-4535-ab95-f2041611897c","Type":"ContainerDied","Data":"e6ef8c90e83f47ffda025d942931332765a05ac9309de97005062ccc7fd2b252"} Jun 10 13:01:56.583187 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.583126 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:56.583187 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.583163 2570 scope.go:117] "RemoveContainer" containerID="2ef317e77926ad28d6ca0f194929c807bd0bc3d5a66f1cc25a5dc6932a58685c" Jun 10 13:01:56.605153 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.605127 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:01:56.608480 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.608453 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:01:56.630596 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.630573 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:01:56.630980 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.630967 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" Jun 10 13:01:56.631029 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.630982 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" Jun 10 13:01:56.631067 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.631040 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="23686b15-2e2f-4535-ab95-f2041611897c" containerName="keycloak" Jun 10 13:01:56.634283 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.634267 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:56.636738 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.636720 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 13:01:56.637011 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.636991 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-nfkqk\"" Jun 10 13:01:56.637107 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.637010 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 13:01:56.637107 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.637027 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 13:01:56.637107 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.637060 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 13:01:56.643934 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.643912 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:01:56.768109 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.768079 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcvrb\" (UniqueName: \"kubernetes.io/projected/b8875e34-49ef-4013-8572-e5ee6882b86f-kube-api-access-vcvrb\") pod \"maas-keycloak-0\" (UID: \"b8875e34-49ef-4013-8572-e5ee6882b86f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:56.768282 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.768133 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b8875e34-49ef-4013-8572-e5ee6882b86f-test-realms\") pod \"maas-keycloak-0\" (UID: \"b8875e34-49ef-4013-8572-e5ee6882b86f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:56.869613 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.869584 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcvrb\" (UniqueName: \"kubernetes.io/projected/b8875e34-49ef-4013-8572-e5ee6882b86f-kube-api-access-vcvrb\") pod \"maas-keycloak-0\" (UID: \"b8875e34-49ef-4013-8572-e5ee6882b86f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:56.869770 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.869640 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b8875e34-49ef-4013-8572-e5ee6882b86f-test-realms\") pod \"maas-keycloak-0\" (UID: \"b8875e34-49ef-4013-8572-e5ee6882b86f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:56.870316 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.870298 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/b8875e34-49ef-4013-8572-e5ee6882b86f-test-realms\") pod \"maas-keycloak-0\" (UID: \"b8875e34-49ef-4013-8572-e5ee6882b86f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:56.878425 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.878401 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcvrb\" (UniqueName: \"kubernetes.io/projected/b8875e34-49ef-4013-8572-e5ee6882b86f-kube-api-access-vcvrb\") pod \"maas-keycloak-0\" (UID: \"b8875e34-49ef-4013-8572-e5ee6882b86f\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:56.945621 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:56.945591 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:57.080143 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:57.080119 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:01:57.082199 ip-10-0-140-135 kubenswrapper[2570]: W0610 13:01:57.082169 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8875e34_49ef_4013_8572_e5ee6882b86f.slice/crio-fe2a4d571f4e2253a5cd33035e13122538e4b4327fe50a27091a3f7d109438e0 WatchSource:0}: Error finding container fe2a4d571f4e2253a5cd33035e13122538e4b4327fe50a27091a3f7d109438e0: Status 404 returned error can't find the container with id fe2a4d571f4e2253a5cd33035e13122538e4b4327fe50a27091a3f7d109438e0 Jun 10 13:01:57.592394 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:57.592356 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b8875e34-49ef-4013-8572-e5ee6882b86f","Type":"ContainerStarted","Data":"ccbfe213b74763a3f9774619c35ad35b7e6afe327d24907ba15c8d80d9f540c5"} Jun 10 13:01:57.592848 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:57.592416 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b8875e34-49ef-4013-8572-e5ee6882b86f","Type":"ContainerStarted","Data":"fe2a4d571f4e2253a5cd33035e13122538e4b4327fe50a27091a3f7d109438e0"} Jun 10 13:01:57.931337 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:57.931287 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23686b15-2e2f-4535-ab95-f2041611897c" path="/var/lib/kubelet/pods/23686b15-2e2f-4535-ab95-f2041611897c/volumes" Jun 10 13:01:57.946552 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:57.946519 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 13:01:57.947744 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:57.947705 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:01:58.947027 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:58.946976 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:01:59.946284 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:01:59.946245 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:00.946105 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:00.946048 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:01.946120 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:01.946075 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:02.946597 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:02.946544 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:03.946648 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:03.946604 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:04.946706 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:04.946656 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:05.946268 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:05.946229 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:06.946567 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:06.946531 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:02:06.947096 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:06.946821 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:07.946070 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:07.946023 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:08.945971 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:08.945924 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:09.946347 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:09.946301 2570 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused" Jun 10 13:02:11.070963 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:11.070925 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 13:02:11.088165 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:11.088127 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:02:11.094924 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:11.094843 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=14.776653354 podStartE2EDuration="15.0948212s" totalImagesPullingTime="318.167846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:01:57.611726784 +0000 UTC m=+832.164251565" watchObservedRunningTime="2026-06-10 13:02:11.0948212 +0000 UTC m=+845.647345981" Jun 10 13:02:21.075334 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:21.075279 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b8875e34-49ef-4013-8572-e5ee6882b86f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:02:31.078207 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:31.078177 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:02:43.878378 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:43.878332 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:44.966086 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:44.966039 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:02:53.614418 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:02:53.614319 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:02.299632 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.299593 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t"] Jun 10 13:03:02.302375 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.302358 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.305914 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.305864 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 13:03:02.306230 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.306210 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 13:03:02.306543 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.306231 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qvqj4\"" Jun 10 13:03:02.306633 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.306302 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 13:03:02.318662 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.318632 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t"] Jun 10 13:03:02.325825 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.325795 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:02.364730 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.364697 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.364730 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.364732 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.365059 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.364767 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwjvf\" (UniqueName: \"kubernetes.io/projected/34b33036-c33b-42df-9c79-62d58b4ee663-kube-api-access-kwjvf\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.365059 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.364819 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.365059 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.364853 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.365059 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.364900 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34b33036-c33b-42df-9c79-62d58b4ee663-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.465604 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.465570 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.465604 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.465601 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.465988 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.465635 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwjvf\" (UniqueName: \"kubernetes.io/projected/34b33036-c33b-42df-9c79-62d58b4ee663-kube-api-access-kwjvf\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.465988 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.465668 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.465988 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.465704 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.465988 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.465727 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34b33036-c33b-42df-9c79-62d58b4ee663-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.466200 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.466053 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.466200 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.466080 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.466200 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.466113 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.468000 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.467977 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34b33036-c33b-42df-9c79-62d58b4ee663-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.468388 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.468372 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34b33036-c33b-42df-9c79-62d58b4ee663-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.474622 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.474603 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwjvf\" (UniqueName: \"kubernetes.io/projected/34b33036-c33b-42df-9c79-62d58b4ee663-kube-api-access-kwjvf\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-l4h6t\" (UID: \"34b33036-c33b-42df-9c79-62d58b4ee663\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.612785 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.612746 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" Jun 10 13:03:02.754110 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.754084 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t"] Jun 10 13:03:02.756119 ip-10-0-140-135 kubenswrapper[2570]: W0610 13:03:02.756090 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b33036_c33b_42df_9c79_62d58b4ee663.slice/crio-b80f2d827bfe4abe2c9b2918b1b8ec90e28b61a04baa185f994ad8f55c6ab72f WatchSource:0}: Error finding container b80f2d827bfe4abe2c9b2918b1b8ec90e28b61a04baa185f994ad8f55c6ab72f: Status 404 returned error can't find the container with id b80f2d827bfe4abe2c9b2918b1b8ec90e28b61a04baa185f994ad8f55c6ab72f Jun 10 13:03:02.957580 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:02.957488 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" event={"ID":"34b33036-c33b-42df-9c79-62d58b4ee663","Type":"ContainerStarted","Data":"b80f2d827bfe4abe2c9b2918b1b8ec90e28b61a04baa185f994ad8f55c6ab72f"} Jun 10 13:03:06.050764 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:06.050736 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:03:06.051213 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:06.051073 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:03:06.055245 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:06.055222 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 13:03:06.055633 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:06.055618 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 13:03:06.980694 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:06.980655 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-l4h6t" event={"ID":"34b33036-c33b-42df-9c79-62d58b4ee663","Type":"ContainerStarted","Data":"9f5f8381cba36a569c63bfd8b89bb4ef3abf2669127ac20d71ae413da3765395"} Jun 10 13:03:09.140852 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:09.140816 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:09.512924 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:09.512808 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:09.571927 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:09.571896 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:14.600544 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:14.600498 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:20.304797 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.304762 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr"] Jun 10 13:03:20.307324 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.307304 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.310393 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.310377 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 13:03:20.326242 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.326210 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr"] Jun 10 13:03:20.337970 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.337945 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:20.420554 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.420530 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.420675 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.420566 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxjml\" (UniqueName: \"kubernetes.io/projected/ab8540f6-24fa-4369-aa9d-1673cd69c69b-kube-api-access-xxjml\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.420675 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.420592 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8540f6-24fa-4369-aa9d-1673cd69c69b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.420768 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.420675 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.420768 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.420725 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.420768 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.420748 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.522011 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.521979 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.522169 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.522024 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxjml\" (UniqueName: \"kubernetes.io/projected/ab8540f6-24fa-4369-aa9d-1673cd69c69b-kube-api-access-xxjml\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.522169 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.522089 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8540f6-24fa-4369-aa9d-1673cd69c69b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.522169 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.522135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.522336 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.522194 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.522336 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.522227 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.522481 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.522457 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.522553 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.522522 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.522605 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.522579 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.524451 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.524421 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab8540f6-24fa-4369-aa9d-1673cd69c69b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.524624 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.524607 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab8540f6-24fa-4369-aa9d-1673cd69c69b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.542325 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.542302 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxjml\" (UniqueName: \"kubernetes.io/projected/ab8540f6-24fa-4369-aa9d-1673cd69c69b-kube-api-access-xxjml\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr\" (UID: \"ab8540f6-24fa-4369-aa9d-1673cd69c69b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.618224 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.618199 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:20.791314 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:20.789650 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr"] Jun 10 13:03:21.053432 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:21.053348 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" event={"ID":"ab8540f6-24fa-4369-aa9d-1673cd69c69b","Type":"ContainerStarted","Data":"71e00cc931b3c0bdd018b28c4bd4f3e53966959a2775079462f523f441810171"} Jun 10 13:03:21.053432 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:21.053401 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" event={"ID":"ab8540f6-24fa-4369-aa9d-1673cd69c69b","Type":"ContainerStarted","Data":"b814f4ea2c0b5b71f31a57ed9ec56f8312b67ad99bbdd521f89784e27d8412c9"} Jun 10 13:03:23.065155 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:23.065119 2570 generic.go:356] "Generic (PLEG): container finished" podID="ab8540f6-24fa-4369-aa9d-1673cd69c69b" containerID="71e00cc931b3c0bdd018b28c4bd4f3e53966959a2775079462f523f441810171" exitCode=0 Jun 10 13:03:23.065542 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:23.065187 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" event={"ID":"ab8540f6-24fa-4369-aa9d-1673cd69c69b","Type":"ContainerDied","Data":"71e00cc931b3c0bdd018b28c4bd4f3e53966959a2775079462f523f441810171"} Jun 10 13:03:23.469590 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:23.469558 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:23.532592 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:23.532566 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:25.080526 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:25.080440 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" event={"ID":"ab8540f6-24fa-4369-aa9d-1673cd69c69b","Type":"ContainerStarted","Data":"75794f49e64a1a9ac80797ef335dda3865c8e04671d9e87c850e72fe35bc229e"} Jun 10 13:03:25.099039 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:25.098983 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" podStartSLOduration=2.095712242 podStartE2EDuration="5.098964077s" totalImagesPullingTime="1.669357734s" totalInitContainerRuntime="1.333894101s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:25.0982599 +0000 UTC m=+919.650784692" watchObservedRunningTime="2026-06-10 13:03:25.098964077 +0000 UTC m=+919.651488860" Jun 10 13:03:30.618341 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:30.618306 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:30.618754 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:30.618398 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:30.630461 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:30.630436 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:31.129373 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:31.129345 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr" Jun 10 13:03:39.441024 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:39.440992 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:41.404208 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:41.404174 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:46.283220 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.282781 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc"] Jun 10 13:03:46.302432 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.302400 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc"] Jun 10 13:03:46.302579 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.302538 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.304934 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.304902 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 13:03:46.311668 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.311142 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:46.344485 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.344451 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.344628 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.344502 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.344628 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.344529 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqkmv\" (UniqueName: \"kubernetes.io/projected/2a49c0cc-db8a-471f-977c-42eb75b2629b-kube-api-access-bqkmv\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.344628 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.344585 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.344628 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.344612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a49c0cc-db8a-471f-977c-42eb75b2629b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.344773 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.344669 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.445849 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.445816 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.445849 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.445851 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a49c0cc-db8a-471f-977c-42eb75b2629b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.446034 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.445917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.446034 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.445974 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.446034 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.446013 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.446191 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.446036 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqkmv\" (UniqueName: \"kubernetes.io/projected/2a49c0cc-db8a-471f-977c-42eb75b2629b-kube-api-access-bqkmv\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.446320 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.446298 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.446388 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.446334 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.446388 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.446365 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.448207 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.448181 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2a49c0cc-db8a-471f-977c-42eb75b2629b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.448506 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.448486 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a49c0cc-db8a-471f-977c-42eb75b2629b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.454511 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.454489 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqkmv\" (UniqueName: \"kubernetes.io/projected/2a49c0cc-db8a-471f-977c-42eb75b2629b-kube-api-access-bqkmv\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-ldpnc\" (UID: \"2a49c0cc-db8a-471f-977c-42eb75b2629b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.614376 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.614341 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:46.957887 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:46.957853 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc"] Jun 10 13:03:46.959787 ip-10-0-140-135 kubenswrapper[2570]: W0610 13:03:46.959762 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a49c0cc_db8a_471f_977c_42eb75b2629b.slice/crio-b7729ef40ae0a1724bc9db006c25f344d770132e22d30a93a6c535cf62afe561 WatchSource:0}: Error finding container b7729ef40ae0a1724bc9db006c25f344d770132e22d30a93a6c535cf62afe561: Status 404 returned error can't find the container with id b7729ef40ae0a1724bc9db006c25f344d770132e22d30a93a6c535cf62afe561 Jun 10 13:03:47.198868 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:47.198836 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" event={"ID":"2a49c0cc-db8a-471f-977c-42eb75b2629b","Type":"ContainerStarted","Data":"3a14a7ac0b6813f2c06a9f4c11bc1936a225513aa5acda60f6aa2fdb2acdbb2b"} Jun 10 13:03:47.198868 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:47.198889 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" event={"ID":"2a49c0cc-db8a-471f-977c-42eb75b2629b","Type":"ContainerStarted","Data":"b7729ef40ae0a1724bc9db006c25f344d770132e22d30a93a6c535cf62afe561"} Jun 10 13:03:49.210687 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:49.210655 2570 generic.go:356] "Generic (PLEG): container finished" podID="2a49c0cc-db8a-471f-977c-42eb75b2629b" containerID="3a14a7ac0b6813f2c06a9f4c11bc1936a225513aa5acda60f6aa2fdb2acdbb2b" exitCode=0 Jun 10 13:03:49.211137 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:49.210731 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" event={"ID":"2a49c0cc-db8a-471f-977c-42eb75b2629b","Type":"ContainerDied","Data":"3a14a7ac0b6813f2c06a9f4c11bc1936a225513aa5acda60f6aa2fdb2acdbb2b"} Jun 10 13:03:49.211347 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:49.211331 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:03:50.217798 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:50.217762 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" event={"ID":"2a49c0cc-db8a-471f-977c-42eb75b2629b","Type":"ContainerStarted","Data":"a35af2f808e7a6a1231b4e2c60b4a3a60f6ed3f9f7f87926fc77ec8dc2cb6909"} Jun 10 13:03:50.238823 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:50.238754 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" podStartSLOduration=2.564568441 podStartE2EDuration="4.23873431s" totalImagesPullingTime="376.381389ms" totalInitContainerRuntime="1.29778448s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:50.238332534 +0000 UTC m=+944.790857340" watchObservedRunningTime="2026-06-10 13:03:50.23873431 +0000 UTC m=+944.791259091" Jun 10 13:03:51.906278 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:51.906249 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:51.962285 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:51.962253 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:52.020304 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:52.020276 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:56.524902 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:56.524858 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:03:56.615086 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:56.615042 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:56.615086 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:56.615090 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:56.627803 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:56.627772 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:03:57.266438 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:03:57.266410 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-ldpnc" Jun 10 13:04:30.886533 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:04:30.886455 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:30.993162 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:04:30.993128 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:32.003935 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:04:32.003870 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:32.102617 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:04:32.102579 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:58.389754 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.389673 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:58.490759 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.490723 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dbc685b49-nq5nq"] Jun 10 13:05:58.490979 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.490953 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" podUID="5f8db679-227d-43db-a8a5-2dfb4c8802cb" containerName="manager" containerID="cri-o://3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8" gracePeriod=30 Jun 10 13:05:58.745289 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.745265 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:05:58.853662 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.853616 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhjhk\" (UniqueName: \"kubernetes.io/projected/5f8db679-227d-43db-a8a5-2dfb4c8802cb-kube-api-access-jhjhk\") pod \"5f8db679-227d-43db-a8a5-2dfb4c8802cb\" (UID: \"5f8db679-227d-43db-a8a5-2dfb4c8802cb\") " Jun 10 13:05:58.853662 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.853678 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f8db679-227d-43db-a8a5-2dfb4c8802cb-webhook-cert\") pod \"5f8db679-227d-43db-a8a5-2dfb4c8802cb\" (UID: \"5f8db679-227d-43db-a8a5-2dfb4c8802cb\") " Jun 10 13:05:58.855712 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.855687 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f8db679-227d-43db-a8a5-2dfb4c8802cb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5f8db679-227d-43db-a8a5-2dfb4c8802cb" (UID: "5f8db679-227d-43db-a8a5-2dfb4c8802cb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:05:58.855820 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.855747 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8db679-227d-43db-a8a5-2dfb4c8802cb-kube-api-access-jhjhk" (OuterVolumeSpecName: "kube-api-access-jhjhk") pod "5f8db679-227d-43db-a8a5-2dfb4c8802cb" (UID: "5f8db679-227d-43db-a8a5-2dfb4c8802cb"). InnerVolumeSpecName "kube-api-access-jhjhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:05:58.893162 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.893131 2570 generic.go:356] "Generic (PLEG): container finished" podID="5f8db679-227d-43db-a8a5-2dfb4c8802cb" containerID="3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8" exitCode=0 Jun 10 13:05:58.893319 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.893174 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" Jun 10 13:05:58.893319 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.893222 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" event={"ID":"5f8db679-227d-43db-a8a5-2dfb4c8802cb","Type":"ContainerDied","Data":"3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8"} Jun 10 13:05:58.893319 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.893281 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dbc685b49-nq5nq" event={"ID":"5f8db679-227d-43db-a8a5-2dfb4c8802cb","Type":"ContainerDied","Data":"35e8ee2057989b35eb9ca16317621edc583ac743c57b680cb9927463f1430cc0"} Jun 10 13:05:58.893319 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.893310 2570 scope.go:117] "RemoveContainer" containerID="3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8" Jun 10 13:05:58.902435 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.902418 2570 scope.go:117] "RemoveContainer" containerID="3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8" Jun 10 13:05:58.902697 ip-10-0-140-135 kubenswrapper[2570]: E0610 13:05:58.902677 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8\": container with ID starting with 3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8 not found: ID does not exist" containerID="3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8" Jun 10 13:05:58.902758 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.902706 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8"} err="failed to get container status \"3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8\": rpc error: code = NotFound desc = could not find container \"3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8\": container with ID starting with 3973c8a5d389447c09d5963f9af890c2a16f6871fa0f8485f05aa2d5a5750ed8 not found: ID does not exist" Jun 10 13:05:58.915739 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.915675 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dbc685b49-nq5nq"] Jun 10 13:05:58.922286 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.922265 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dbc685b49-nq5nq"] Jun 10 13:05:58.954652 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.954629 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhjhk\" (UniqueName: \"kubernetes.io/projected/5f8db679-227d-43db-a8a5-2dfb4c8802cb-kube-api-access-jhjhk\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 13:05:58.954652 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:58.954650 2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f8db679-227d-43db-a8a5-2dfb4c8802cb-webhook-cert\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 13:05:59.569031 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.568999 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:05:59.683147 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.683108 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dbc685b49-rfchw"] Jun 10 13:05:59.683773 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.683747 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f8db679-227d-43db-a8a5-2dfb4c8802cb" containerName="manager" Jun 10 13:05:59.683773 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.683772 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f8db679-227d-43db-a8a5-2dfb4c8802cb" containerName="manager" Jun 10 13:05:59.684049 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.683868 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f8db679-227d-43db-a8a5-2dfb4c8802cb" containerName="manager" Jun 10 13:05:59.688768 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.688748 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dbc685b49-rfchw" Jun 10 13:05:59.691249 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.691227 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9xrt9\"" Jun 10 13:05:59.691339 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.691252 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 13:05:59.691339 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.691312 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 13:05:59.695483 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.695460 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dbc685b49-rfchw"] Jun 10 13:05:59.762290 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.762259 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71825eaa-b6da-4fa5-873c-5af5d4659ed2-webhook-cert\") pod \"maas-controller-7dbc685b49-rfchw\" (UID: \"71825eaa-b6da-4fa5-873c-5af5d4659ed2\") " pod="opendatahub/maas-controller-7dbc685b49-rfchw" Jun 10 13:05:59.762477 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.762371 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdhk9\" (UniqueName: \"kubernetes.io/projected/71825eaa-b6da-4fa5-873c-5af5d4659ed2-kube-api-access-tdhk9\") pod \"maas-controller-7dbc685b49-rfchw\" (UID: \"71825eaa-b6da-4fa5-873c-5af5d4659ed2\") " pod="opendatahub/maas-controller-7dbc685b49-rfchw" Jun 10 13:05:59.862860 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.862824 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdhk9\" (UniqueName: \"kubernetes.io/projected/71825eaa-b6da-4fa5-873c-5af5d4659ed2-kube-api-access-tdhk9\") pod \"maas-controller-7dbc685b49-rfchw\" (UID: \"71825eaa-b6da-4fa5-873c-5af5d4659ed2\") " pod="opendatahub/maas-controller-7dbc685b49-rfchw" Jun 10 13:05:59.863026 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.862929 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71825eaa-b6da-4fa5-873c-5af5d4659ed2-webhook-cert\") pod \"maas-controller-7dbc685b49-rfchw\" (UID: \"71825eaa-b6da-4fa5-873c-5af5d4659ed2\") " pod="opendatahub/maas-controller-7dbc685b49-rfchw" Jun 10 13:05:59.865339 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.865321 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/71825eaa-b6da-4fa5-873c-5af5d4659ed2-webhook-cert\") pod \"maas-controller-7dbc685b49-rfchw\" (UID: \"71825eaa-b6da-4fa5-873c-5af5d4659ed2\") " pod="opendatahub/maas-controller-7dbc685b49-rfchw" Jun 10 13:05:59.871919 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.871895 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdhk9\" (UniqueName: \"kubernetes.io/projected/71825eaa-b6da-4fa5-873c-5af5d4659ed2-kube-api-access-tdhk9\") pod \"maas-controller-7dbc685b49-rfchw\" (UID: \"71825eaa-b6da-4fa5-873c-5af5d4659ed2\") " pod="opendatahub/maas-controller-7dbc685b49-rfchw" Jun 10 13:05:59.928630 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:05:59.928593 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f8db679-227d-43db-a8a5-2dfb4c8802cb" path="/var/lib/kubelet/pods/5f8db679-227d-43db-a8a5-2dfb4c8802cb/volumes" Jun 10 13:06:00.000256 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:00.000212 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dbc685b49-rfchw" Jun 10 13:06:00.135235 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:00.135211 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dbc685b49-rfchw"] Jun 10 13:06:00.137464 ip-10-0-140-135 kubenswrapper[2570]: W0610 13:06:00.137439 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71825eaa_b6da_4fa5_873c_5af5d4659ed2.slice/crio-913c5d2ecd91fd4935bcd4ef86e52de28d102da6e59951a0bb39cb7f58aae941 WatchSource:0}: Error finding container 913c5d2ecd91fd4935bcd4ef86e52de28d102da6e59951a0bb39cb7f58aae941: Status 404 returned error can't find the container with id 913c5d2ecd91fd4935bcd4ef86e52de28d102da6e59951a0bb39cb7f58aae941 Jun 10 13:06:00.906027 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:00.905995 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dbc685b49-rfchw" event={"ID":"71825eaa-b6da-4fa5-873c-5af5d4659ed2","Type":"ContainerStarted","Data":"abf8e67edd61eba42751aa65457c1edfa975515a3d2dc68091de8964b8645229"} Jun 10 13:06:00.906428 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:00.906050 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dbc685b49-rfchw" event={"ID":"71825eaa-b6da-4fa5-873c-5af5d4659ed2","Type":"ContainerStarted","Data":"913c5d2ecd91fd4935bcd4ef86e52de28d102da6e59951a0bb39cb7f58aae941"} Jun 10 13:06:00.906428 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:00.906082 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dbc685b49-rfchw" Jun 10 13:06:00.924903 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:00.924796 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7dbc685b49-rfchw" podStartSLOduration=1.50283674 podStartE2EDuration="1.924773882s" totalImagesPullingTime="421.937142ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:00.924699893 +0000 UTC m=+1075.477224676" watchObservedRunningTime="2026-06-10 13:06:00.924773882 +0000 UTC m=+1075.477298662" Jun 10 13:06:11.917628 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:11.917599 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dbc685b49-rfchw" Jun 10 13:06:41.583642 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:41.583606 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:41.683475 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:41.683440 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:41.906235 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:41.906194 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:42.348594 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:42.348562 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:42.448856 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:42.448822 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:50.184770 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:50.184737 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:56.442651 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:56.442616 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:06:56.621018 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:06:56.620980 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:28.577794 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:28.577691 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:28.672758 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:28.672723 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:28.838032 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:28.837998 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:29.445518 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:29.445485 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:29.546680 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:29.546647 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:52.565390 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:52.565353 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:58.507098 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:58.507065 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:58.581555 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:58.581514 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:58.692488 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:58.692450 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:58.799622 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:58.799525 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:58.905535 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:58.905497 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:07:59.006044 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:07:59.006016 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:06.082219 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:06.082188 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:08:06.084672 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:06.084646 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:08:06.086751 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:06.086722 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 13:08:06.092180 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:06.092156 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 13:08:15.400648 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:15.400610 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:15.519079 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:15.519050 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:15.629896 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:15.629849 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:21.976268 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:21.976224 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:22.077674 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:22.077640 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:30.123579 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:30.123537 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:30.226131 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:30.226098 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:30.323106 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:30.323071 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:30.426349 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:30.426266 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:46.918033 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:46.917993 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:47.017580 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:47.017552 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:47.133036 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:47.133003 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:53.201943 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:53.201844 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:08:53.305651 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:08:53.305614 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:13.631505 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:13.631456 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:13.722004 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:13.721971 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:13.842453 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:13.842420 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:20.242298 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:20.242262 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:20.348027 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:20.347994 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:20.538989 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:20.538914 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:20.797679 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:20.797591 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:26.583602 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:26.583571 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:26.640659 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:26.640630 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:30.373676 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:30.373642 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:30.494507 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:30.494473 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:50.114242 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:50.114198 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:51.937194 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:51.937163 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:09:52.007043 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:09:52.007016 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:22.359332 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:11:22.359298 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:22.874318 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:11:22.874284 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:11:22.976183 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:11:22.976140 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:12:56.755620 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:12:56.755581 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:13:06.117366 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:13:06.117336 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:13:06.120529 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:13:06.120505 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:13:06.121967 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:13:06.121946 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 13:13:06.125229 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:13:06.125206 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 13:16:29.975684 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:29.974829 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb"] Jun 10 13:16:29.975684 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:29.975161 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" podUID="e0fe4160-7e2d-4204-a17d-c42df8483978" containerName="manager" containerID="cri-o://0349984572dbb2ab292e6975c0398ec6336d90a350a07b5666ef12ee530b3af1" gracePeriod=10 Jun 10 13:16:30.203400 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:30.203369 2570 generic.go:356] "Generic (PLEG): container finished" podID="e0fe4160-7e2d-4204-a17d-c42df8483978" containerID="0349984572dbb2ab292e6975c0398ec6336d90a350a07b5666ef12ee530b3af1" exitCode=0 Jun 10 13:16:30.203572 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:30.203444 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" event={"ID":"e0fe4160-7e2d-4204-a17d-c42df8483978","Type":"ContainerDied","Data":"0349984572dbb2ab292e6975c0398ec6336d90a350a07b5666ef12ee530b3af1"} Jun 10 13:16:30.242072 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:30.242049 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 13:16:30.342681 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:30.342637 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0fe4160-7e2d-4204-a17d-c42df8483978-extensions-socket-volume\") pod \"e0fe4160-7e2d-4204-a17d-c42df8483978\" (UID: \"e0fe4160-7e2d-4204-a17d-c42df8483978\") " Jun 10 13:16:30.342681 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:30.342689 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbcqr\" (UniqueName: \"kubernetes.io/projected/e0fe4160-7e2d-4204-a17d-c42df8483978-kube-api-access-qbcqr\") pod \"e0fe4160-7e2d-4204-a17d-c42df8483978\" (UID: \"e0fe4160-7e2d-4204-a17d-c42df8483978\") " Jun 10 13:16:30.343055 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:30.343030 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0fe4160-7e2d-4204-a17d-c42df8483978-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e0fe4160-7e2d-4204-a17d-c42df8483978" (UID: "e0fe4160-7e2d-4204-a17d-c42df8483978"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:16:30.344840 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:30.344820 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0fe4160-7e2d-4204-a17d-c42df8483978-kube-api-access-qbcqr" (OuterVolumeSpecName: "kube-api-access-qbcqr") pod "e0fe4160-7e2d-4204-a17d-c42df8483978" (UID: "e0fe4160-7e2d-4204-a17d-c42df8483978"). InnerVolumeSpecName "kube-api-access-qbcqr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:16:30.443998 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:30.443951 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0fe4160-7e2d-4204-a17d-c42df8483978-extensions-socket-volume\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 13:16:30.443998 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:30.443992 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbcqr\" (UniqueName: \"kubernetes.io/projected/e0fe4160-7e2d-4204-a17d-c42df8483978-kube-api-access-qbcqr\") on node \"ip-10-0-140-135.ec2.internal\" DevicePath \"\"" Jun 10 13:16:31.210519 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:31.210491 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" Jun 10 13:16:31.210519 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:31.210500 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb" event={"ID":"e0fe4160-7e2d-4204-a17d-c42df8483978","Type":"ContainerDied","Data":"2d0fe5e4c4d59d02108c45fa4b850a5fde7ebaa4daeb6d8857505e397c0f23be"} Jun 10 13:16:31.211105 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:31.210556 2570 scope.go:117] "RemoveContainer" containerID="0349984572dbb2ab292e6975c0398ec6336d90a350a07b5666ef12ee530b3af1" Jun 10 13:16:31.239516 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:31.239487 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb"] Jun 10 13:16:31.243563 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:31.243538 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r2kvb"] Jun 10 13:16:31.930318 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:16:31.930282 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0fe4160-7e2d-4204-a17d-c42df8483978" path="/var/lib/kubelet/pods/e0fe4160-7e2d-4204-a17d-c42df8483978/volumes" Jun 10 13:17:02.220014 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:02.219975 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:17:36.089578 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.089542 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6"] Jun 10 13:17:36.090075 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.089945 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0fe4160-7e2d-4204-a17d-c42df8483978" containerName="manager" Jun 10 13:17:36.090075 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.089957 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0fe4160-7e2d-4204-a17d-c42df8483978" containerName="manager" Jun 10 13:17:36.090075 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.090030 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0fe4160-7e2d-4204-a17d-c42df8483978" containerName="manager" Jun 10 13:17:36.092279 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.092258 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" Jun 10 13:17:36.095074 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.095054 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hknzp\"" Jun 10 13:17:36.102980 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.102958 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6"] Jun 10 13:17:36.170384 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.170347 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edd01058-e74b-4c2f-9872-fb7435004b2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4s6\" (UID: \"edd01058-e74b-4c2f-9872-fb7435004b2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" Jun 10 13:17:36.170384 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.170383 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnzb8\" (UniqueName: \"kubernetes.io/projected/edd01058-e74b-4c2f-9872-fb7435004b2b-kube-api-access-lnzb8\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4s6\" (UID: \"edd01058-e74b-4c2f-9872-fb7435004b2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" Jun 10 13:17:36.271329 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.271287 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edd01058-e74b-4c2f-9872-fb7435004b2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4s6\" (UID: \"edd01058-e74b-4c2f-9872-fb7435004b2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" Jun 10 13:17:36.271329 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.271328 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnzb8\" (UniqueName: \"kubernetes.io/projected/edd01058-e74b-4c2f-9872-fb7435004b2b-kube-api-access-lnzb8\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4s6\" (UID: \"edd01058-e74b-4c2f-9872-fb7435004b2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" Jun 10 13:17:36.271681 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.271659 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/edd01058-e74b-4c2f-9872-fb7435004b2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4s6\" (UID: \"edd01058-e74b-4c2f-9872-fb7435004b2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" Jun 10 13:17:36.280216 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.280191 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnzb8\" (UniqueName: \"kubernetes.io/projected/edd01058-e74b-4c2f-9872-fb7435004b2b-kube-api-access-lnzb8\") pod \"kuadrant-operator-controller-manager-86878c769f-hq4s6\" (UID: \"edd01058-e74b-4c2f-9872-fb7435004b2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" Jun 10 13:17:36.402713 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.402618 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" Jun 10 13:17:36.544998 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.544930 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6"] Jun 10 13:17:36.547687 ip-10-0-140-135 kubenswrapper[2570]: W0610 13:17:36.547657 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd01058_e74b_4c2f_9872_fb7435004b2b.slice/crio-defeda8aaba93d3a8753ad6cb467d9f2099f8f3041a0db6a9e7a8f7b3bc68e92 WatchSource:0}: Error finding container defeda8aaba93d3a8753ad6cb467d9f2099f8f3041a0db6a9e7a8f7b3bc68e92: Status 404 returned error can't find the container with id defeda8aaba93d3a8753ad6cb467d9f2099f8f3041a0db6a9e7a8f7b3bc68e92 Jun 10 13:17:36.558200 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:36.558171 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" event={"ID":"edd01058-e74b-4c2f-9872-fb7435004b2b","Type":"ContainerStarted","Data":"defeda8aaba93d3a8753ad6cb467d9f2099f8f3041a0db6a9e7a8f7b3bc68e92"} Jun 10 13:17:37.564995 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:37.564962 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" event={"ID":"edd01058-e74b-4c2f-9872-fb7435004b2b","Type":"ContainerStarted","Data":"246aa1cf6fe56ab761031c2afde2f4159a8cf04eff48f7eb4bd40dd07d311530"} Jun 10 13:17:37.565397 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:37.565092 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" Jun 10 13:17:37.586568 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:37.586519 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" podStartSLOduration=1.586501937 podStartE2EDuration="1.586501937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:17:37.584843075 +0000 UTC m=+1772.137367857" watchObservedRunningTime="2026-06-10 13:17:37.586501937 +0000 UTC m=+1772.139026718" Jun 10 13:17:48.572861 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:17:48.572830 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hq4s6" Jun 10 13:18:06.149273 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:18:06.149239 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:18:06.153995 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:18:06.153972 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 13:18:06.154175 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:18:06.153982 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:18:06.158624 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:18:06.158604 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 13:21:45.332724 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:21:45.332683 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:06.181565 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:23:06.181536 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:23:06.186009 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:23:06.185983 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 13:23:06.188073 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:23:06.188049 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:23:06.192150 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:23:06.192130 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2lkfl_dccf8486-5e33-4ec9-9242-de7a7c2b3347/ovn-acl-logging/0.log" Jun 10 13:23:16.364685 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:23:16.364648 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:16.454015 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:23:16.453978 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:25.786670 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:23:25.786632 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:23:25.903012 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:23:25.902979 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:46.678180 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:46.678151 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8689d8b558-fz5ln_29e8fc7a-4c50-4881-884a-1b299e38b87a/nginx/0.log" Jun 10 13:26:46.920050 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:46.920017 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-45td2_f90d8770-0888-4925-8368-28108e88bb81/manager/0.log" Jun 10 13:26:47.047590 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:47.047515 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-f5vxg_79dcf6e9-6af0-4e99-8bd0-c6a508161302/manager/0.log" Jun 10 13:26:47.168806 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:47.168778 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7dbc685b49-rfchw_71825eaa-b6da-4fa5-873c-5af5d4659ed2/manager/0.log" Jun 10 13:26:47.760215 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:47.760184 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f4c98d49d-tpb54_022b9560-320e-42a0-af5d-bfc12930cd47/copy-manifests/0.log" Jun 10 13:26:47.774246 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:47.774216 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f4c98d49d-tpb54_022b9560-320e-42a0-af5d-bfc12930cd47/manager/0.log" Jun 10 13:26:49.214292 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:49.214262 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s8hhl_496246cb-e93c-4763-9c87-edeefc839f0f/manager/0.log" Jun 10 13:26:49.324837 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:49.324811 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5qtc5_a26de2f4-c461-4470-84f3-7e66f863f1a9/manager/0.log" Jun 10 13:26:49.663421 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:49.663385 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hq4s6_edd01058-e74b-4c2f-9872-fb7435004b2b/manager/0.log" Jun 10 13:26:50.416999 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:50.416968 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-65sdn_c164bdfb-3a70-4e53-a730-1eda10b9ecec/discovery/0.log" Jun 10 13:26:50.527757 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:50.527719 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5796c65c65-4h2tb_a00be2a1-78e9-4cc0-a816-b299ab633734/kube-auth-proxy/0.log" Jun 10 13:26:50.993415 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:50.993386 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2hlsh_f2962e7c-d302-4374-a75a-c04e4e7434c6/payload-processing/0.log" Jun 10 13:26:51.809600 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:51.809558 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr_ab8540f6-24fa-4369-aa9d-1673cd69c69b/storage-initializer/0.log" Jun 10 13:26:51.820979 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:51.820957 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cds9cr_ab8540f6-24fa-4369-aa9d-1673cd69c69b/main/0.log" Jun 10 13:26:52.070524 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:52.070445 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-ldpnc_2a49c0cc-db8a-471f-977c-42eb75b2629b/storage-initializer/0.log" Jun 10 13:26:52.085255 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:52.085231 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-ldpnc_2a49c0cc-db8a-471f-977c-42eb75b2629b/main/0.log" Jun 10 13:26:56.564220 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:56.564183 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:57.587044 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:57.587015 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" limit=1024 Jun 10 13:26:59.420071 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:59.420040 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gtzj7_340d0d25-8681-4a5e-bfbe-28f439bbfd89/global-pull-secret-syncer/0.log" Jun 10 13:26:59.555279 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:59.555248 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ds6pq_585f27a5-5755-4e14-868d-7b3f3c67d71d/konnectivity-agent/0.log" Jun 10 13:26:59.680264 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:26:59.680191 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-135.ec2.internal_2800005ebd22734ffdd825485f6a9839/haproxy/0.log" Jun 10 13:27:02.369240 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:02.369207 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-4z7kn_db034663-8d53-4a3c-9c4b-012a2e46886e/sail-operator/0.log" Jun 10 13:27:04.260110 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:04.260086 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-s8hhl_496246cb-e93c-4763-9c87-edeefc839f0f/manager/0.log" Jun 10 13:27:04.291338 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:04.291309 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5qtc5_a26de2f4-c461-4470-84f3-7e66f863f1a9/manager/0.log" Jun 10 13:27:04.445531 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:04.445502 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hq4s6_edd01058-e74b-4c2f-9872-fb7435004b2b/manager/0.log" Jun 10 13:27:06.300937 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.300904 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a4c6149-0942-4885-9aec-33559091b5c3/alertmanager/0.log" Jun 10 13:27:06.324692 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.324665 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a4c6149-0942-4885-9aec-33559091b5c3/config-reloader/0.log" Jun 10 13:27:06.346265 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.346235 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a4c6149-0942-4885-9aec-33559091b5c3/kube-rbac-proxy-web/0.log" Jun 10 13:27:06.370864 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.370835 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a4c6149-0942-4885-9aec-33559091b5c3/kube-rbac-proxy/0.log" Jun 10 13:27:06.397110 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.397083 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a4c6149-0942-4885-9aec-33559091b5c3/kube-rbac-proxy-metric/0.log" Jun 10 13:27:06.421147 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.421123 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a4c6149-0942-4885-9aec-33559091b5c3/prom-label-proxy/0.log" Jun 10 13:27:06.449277 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.449253 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a4c6149-0942-4885-9aec-33559091b5c3/init-config-reloader/0.log" Jun 10 13:27:06.610030 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.610003 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7km9w_1a024da6-fa8d-489e-ae88-191cb3ff2360/kube-state-metrics/0.log" Jun 10 13:27:06.635599 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.635567 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7km9w_1a024da6-fa8d-489e-ae88-191cb3ff2360/kube-rbac-proxy-main/0.log" Jun 10 13:27:06.658484 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.658458 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-7km9w_1a024da6-fa8d-489e-ae88-191cb3ff2360/kube-rbac-proxy-self/0.log" Jun 10 13:27:06.755104 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.755076 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7j89_18dfa9d8-d11d-470e-8996-1bc7309de117/node-exporter/0.log" Jun 10 13:27:06.777455 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.777430 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7j89_18dfa9d8-d11d-470e-8996-1bc7309de117/kube-rbac-proxy/0.log" Jun 10 13:27:06.800869 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:06.800843 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7j89_18dfa9d8-d11d-470e-8996-1bc7309de117/init-textfile/0.log" Jun 10 13:27:07.350748 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:07.350719 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-htbxv_1e5b8bf1-65c5-41e5-88f1-8383bd602665/prometheus-operator-admission-webhook/0.log" Jun 10 13:27:09.912311 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:09.912283 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/1.log" Jun 10 13:27:09.916069 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:09.916048 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-9vd8v_5aa1127c-4c83-4083-a93b-31d638231dac/console-operator/2.log" Jun 10 13:27:10.551869 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:10.551842 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-fmdnf_33576003-7473-4ff4-b870-562b12a0ea2d/download-server/0.log" Jun 10 13:27:11.235062 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.235029 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-pld4x_60db72e9-5e73-4f71-8642-80d4851cc276/volume-data-source-validator/0.log" Jun 10 13:27:11.770985 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.770944 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8"] Jun 10 13:27:11.773818 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.773794 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.776121 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.776102 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jls6j\"/\"kube-root-ca.crt\"" Jun 10 13:27:11.776236 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.776173 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jls6j\"/\"default-dockercfg-8zlpx\"" Jun 10 13:27:11.776853 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.776834 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jls6j\"/\"openshift-service-ca.crt\"" Jun 10 13:27:11.781832 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.781776 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8"] Jun 10 13:27:11.894095 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.894057 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-sys\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.894095 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.894093 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-proc\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.894357 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.894129 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-podres\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.894357 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.894272 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m9j6\" (UniqueName: \"kubernetes.io/projected/ac6fd758-4059-4462-8cb3-3880f2dd1774-kube-api-access-4m9j6\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.894357 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.894342 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-lib-modules\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.995168 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.995126 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-sys\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.995168 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.995167 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-proc\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.995415 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.995205 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-podres\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.995415 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.995250 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-sys\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.995415 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.995300 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-proc\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.995415 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.995342 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m9j6\" (UniqueName: \"kubernetes.io/projected/ac6fd758-4059-4462-8cb3-3880f2dd1774-kube-api-access-4m9j6\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.995415 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.995409 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-lib-modules\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.995716 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.995438 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-podres\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:11.995716 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:11.995540 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac6fd758-4059-4462-8cb3-3880f2dd1774-lib-modules\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:12.003802 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:12.003780 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m9j6\" (UniqueName: \"kubernetes.io/projected/ac6fd758-4059-4462-8cb3-3880f2dd1774-kube-api-access-4m9j6\") pod \"perf-node-gather-daemonset-ddrh8\" (UID: \"ac6fd758-4059-4462-8cb3-3880f2dd1774\") " pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:12.085109 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:12.085076 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:12.219343 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:12.219316 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8"] Jun 10 13:27:12.221475 ip-10-0-140-135 kubenswrapper[2570]: W0610 13:27:12.221447 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac6fd758_4059_4462_8cb3_3880f2dd1774.slice/crio-813757897bcaf5e08bcea19ef04e638084e4c0d6ac5a64f8cb030fbcea51ac8b WatchSource:0}: Error finding container 813757897bcaf5e08bcea19ef04e638084e4c0d6ac5a64f8cb030fbcea51ac8b: Status 404 returned error can't find the container with id 813757897bcaf5e08bcea19ef04e638084e4c0d6ac5a64f8cb030fbcea51ac8b Jun 10 13:27:12.469894 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:12.469773 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n69pg_7fe937e4-af59-45df-bd54-dac3e7e7aa99/dns/0.log" Jun 10 13:27:12.490819 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:12.490793 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n69pg_7fe937e4-af59-45df-bd54-dac3e7e7aa99/kube-rbac-proxy/0.log" Jun 10 13:27:12.599041 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:12.599005 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" event={"ID":"ac6fd758-4059-4462-8cb3-3880f2dd1774","Type":"ContainerStarted","Data":"e87df086f015cd6fe1d1ee1ad0d7453b5687f9a6014129e603122fae0a3a1d53"} Jun 10 13:27:12.599246 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:12.599060 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" event={"ID":"ac6fd758-4059-4462-8cb3-3880f2dd1774","Type":"ContainerStarted","Data":"813757897bcaf5e08bcea19ef04e638084e4c0d6ac5a64f8cb030fbcea51ac8b"} Jun 10 13:27:12.599246 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:12.599126 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:12.617115 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:12.617063 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" podStartSLOduration=1.6170490339999999 podStartE2EDuration="1.617049034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:27:12.615118 +0000 UTC m=+2347.167642769" watchObservedRunningTime="2026-06-10 13:27:12.617049034 +0000 UTC m=+2347.169573814" Jun 10 13:27:12.617373 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:12.617272 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fr9j5_860e986c-5515-492c-8b7a-fd084ede0dbf/dns-node-resolver/0.log" Jun 10 13:27:13.221888 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:13.221858 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78b6d5dcd4-twlsm_f67f4d23-9bd7-424d-85b6-9745a74d2d88/registry/0.log" Jun 10 13:27:13.243352 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:13.243324 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-76fjd_727d6207-33ea-4612-8898-b513031d9bc4/node-ca/0.log" Jun 10 13:27:14.311098 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:14.311068 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-65sdn_c164bdfb-3a70-4e53-a730-1eda10b9ecec/discovery/0.log" Jun 10 13:27:14.331767 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:14.331737 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5796c65c65-4h2tb_a00be2a1-78e9-4cc0-a816-b299ab633734/kube-auth-proxy/0.log" Jun 10 13:27:14.502372 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:14.502343 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2hlsh_f2962e7c-d302-4374-a75a-c04e4e7434c6/payload-processing/0.log" Jun 10 13:27:15.182663 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:15.182633 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rbnpx_54dacbb9-4aa6-4102-a051-6877ee64180b/serve-healthcheck-canary/0.log" Jun 10 13:27:15.748158 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:15.748128 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-xfw7w_8c58c9f2-1625-49f8-8714-82d111c716f1/insights-operator/0.log" Jun 10 13:27:15.748571 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:15.748424 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-xfw7w_8c58c9f2-1625-49f8-8714-82d111c716f1/insights-operator/1.log" Jun 10 13:27:15.916452 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:15.916411 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xcw6s_756784a5-2d72-4345-925c-d7dfa2f2fc71/kube-rbac-proxy/0.log" Jun 10 13:27:15.948191 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:15.948163 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xcw6s_756784a5-2d72-4345-925c-d7dfa2f2fc71/exporter/0.log" Jun 10 13:27:15.970653 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:15.970626 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xcw6s_756784a5-2d72-4345-925c-d7dfa2f2fc71/extractor/0.log" Jun 10 13:27:18.327821 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:18.327793 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8689d8b558-fz5ln_29e8fc7a-4c50-4881-884a-1b299e38b87a/nginx/0.log" Jun 10 13:27:18.377450 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:18.377422 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-45td2_f90d8770-0888-4925-8368-28108e88bb81/manager/0.log" Jun 10 13:27:18.446115 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:18.446079 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-f5vxg_79dcf6e9-6af0-4e99-8bd0-c6a508161302/manager/0.log" Jun 10 13:27:18.509521 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:18.509488 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7dbc685b49-rfchw_71825eaa-b6da-4fa5-873c-5af5d4659ed2/manager/0.log" Jun 10 13:27:18.614892 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:18.614856 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jls6j/perf-node-gather-daemonset-ddrh8" Jun 10 13:27:18.792115 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:18.792083 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f4c98d49d-tpb54_022b9560-320e-42a0-af5d-bfc12930cd47/manager/0.log" Jun 10 13:27:18.823029 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:18.823002 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f4c98d49d-tpb54_022b9560-320e-42a0-af5d-bfc12930cd47/copy-manifests/0.log" Jun 10 13:27:24.821894 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:24.821829 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-65sdn_c164bdfb-3a70-4e53-a730-1eda10b9ecec/discovery/0.log" Jun 10 13:27:24.840807 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:24.840780 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5796c65c65-4h2tb_a00be2a1-78e9-4cc0-a816-b299ab633734/kube-auth-proxy/0.log" Jun 10 13:27:25.059021 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:25.058988 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2hlsh_f2962e7c-d302-4374-a75a-c04e4e7434c6/payload-processing/0.log" Jun 10 13:27:26.266424 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:26.266393 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-65sdn_c164bdfb-3a70-4e53-a730-1eda10b9ecec/discovery/0.log" Jun 10 13:27:26.269654 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:26.269633 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sv5jh_9de970a5-e924-455f-ab16-592759956f53/migrator/0.log" Jun 10 13:27:26.286329 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:26.286307 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5796c65c65-4h2tb_a00be2a1-78e9-4cc0-a816-b299ab633734/kube-auth-proxy/0.log" Jun 10 13:27:26.310257 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:26.310232 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-sv5jh_9de970a5-e924-455f-ab16-592759956f53/graceful-termination/0.log" Jun 10 13:27:26.432317 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:26.432289 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2hlsh_f2962e7c-d302-4374-a75a-c04e4e7434c6/payload-processing/0.log" Jun 10 13:27:28.177960 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.177925 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-65sdn_c164bdfb-3a70-4e53-a730-1eda10b9ecec/discovery/0.log" Jun 10 13:27:28.188585 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.188559 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5796c65c65-4h2tb_a00be2a1-78e9-4cc0-a816-b299ab633734/kube-auth-proxy/0.log" Jun 10 13:27:28.319630 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.319597 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2hlsh_f2962e7c-d302-4374-a75a-c04e4e7434c6/payload-processing/0.log" Jun 10 13:27:28.478312 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.478230 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6p7s_40985e58-d53c-4ddb-8b4c-8bf40c46aa5d/kube-multus-additional-cni-plugins/0.log" Jun 10 13:27:28.502088 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.502063 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6p7s_40985e58-d53c-4ddb-8b4c-8bf40c46aa5d/egress-router-binary-copy/0.log" Jun 10 13:27:28.523692 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.523669 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6p7s_40985e58-d53c-4ddb-8b4c-8bf40c46aa5d/cni-plugins/0.log" Jun 10 13:27:28.545423 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.545398 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6p7s_40985e58-d53c-4ddb-8b4c-8bf40c46aa5d/bond-cni-plugin/0.log" Jun 10 13:27:28.573929 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.573899 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6p7s_40985e58-d53c-4ddb-8b4c-8bf40c46aa5d/routeoverride-cni/0.log" Jun 10 13:27:28.605939 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.605918 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6p7s_40985e58-d53c-4ddb-8b4c-8bf40c46aa5d/whereabouts-cni-bincopy/0.log" Jun 10 13:27:28.630459 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.630434 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6p7s_40985e58-d53c-4ddb-8b4c-8bf40c46aa5d/whereabouts-cni/0.log" Jun 10 13:27:28.664690 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.664660 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qxgn4_c09c65d1-5f9e-4ae3-9a4b-7451e4e56963/kube-multus/0.log" Jun 10 13:27:28.854365 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.854339 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pgwrf_19924bce-75e7-45a1-8222-5f6b693f9dc4/network-metrics-daemon/0.log" Jun 10 13:27:28.877113 ip-10-0-140-135 kubenswrapper[2570]: I0610 13:27:28.877082 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pgwrf_19924bce-75e7-45a1-8222-5f6b693f9dc4/kube-rbac-proxy/0.log"