Jun 14 03:12:56.762094 ip-10-0-137-82 systemd[1]: Starting Kubernetes Kubelet... Jun 14 03:12:57.184483 ip-10-0-137-82 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 03:12:57.184483 ip-10-0-137-82 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 03:12:57.184483 ip-10-0-137-82 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 03:12:57.184483 ip-10-0-137-82 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 03:12:57.184483 ip-10-0-137-82 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 03:12:57.185698 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.185454 2547 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 03:12:57.189362 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189344 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:12:57.189362 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189361 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189365 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189369 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189372 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189375 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189379 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189382 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189384 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189387 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189390 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189392 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189395 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189398 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189401 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189404 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189409 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189412 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189416 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189420 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189423 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:12:57.189432 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189425 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189428 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189430 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189433 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189436 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189439 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189442 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189445 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189448 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189450 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189453 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189455 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189459 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189461 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189464 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189467 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189470 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189473 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189475 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189478 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:12:57.189923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189481 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189484 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189487 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189489 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189492 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189494 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189497 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189500 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189502 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189505 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189507 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189510 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189512 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189515 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189518 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189521 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189524 2547 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189527 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189529 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189532 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:12:57.190416 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189535 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189537 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189540 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189542 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189545 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189547 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189550 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189552 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189555 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189558 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189561 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189565 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189569 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189572 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189575 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189577 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189580 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189584 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189587 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:12:57.190927 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189590 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189593 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189595 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189598 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189600 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189603 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189606 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189610 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189613 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189615 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189619 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189622 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189625 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189627 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189630 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189633 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189635 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189638 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.189641 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190374 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:12:57.191430 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190381 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190384 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190395 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190399 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190404 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190407 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190410 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190413 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190416 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190419 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190423 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190426 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190429 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190433 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190436 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190439 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190442 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190445 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190448 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:12:57.191929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190452 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190455 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190458 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190461 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190464 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190466 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190469 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190471 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190474 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190477 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190479 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190482 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190485 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190487 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190490 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190492 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190495 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190497 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190501 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190503 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:12:57.192391 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190506 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190509 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190511 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190513 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190516 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190519 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190521 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190524 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190527 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190530 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190532 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190535 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190538 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190541 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190545 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190549 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190552 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190555 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190557 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:12:57.192895 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190560 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190564 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190567 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190571 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190574 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190576 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190579 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190582 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190584 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190587 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190590 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190592 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190595 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190598 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190601 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190603 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190606 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190608 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190611 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190614 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:12:57.193367 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190617 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190619 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190622 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190625 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190627 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190630 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190632 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190635 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190638 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190640 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190645 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190649 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190651 2547 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190654 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190657 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190660 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190663 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190665 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190668 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:12:57.193866 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.190670 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191078 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191083 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191086 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191089 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191093 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191095 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191098 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191100 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191103 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191105 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191108 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191111 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191114 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191117 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191120 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191122 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191125 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191128 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191130 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:12:57.194332 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191133 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191138 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191141 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191144 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191147 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191150 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191153 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191155 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191158 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191161 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191164 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191167 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191170 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191172 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191175 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191177 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191180 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191183 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191186 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191188 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:12:57.194848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191191 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191193 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191196 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191198 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191201 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191207 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191210 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191212 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191215 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191217 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191220 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191223 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191226 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191229 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191231 2547 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191234 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191236 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191239 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191241 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191244 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:12:57.195345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191246 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191249 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191251 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191255 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191260 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191263 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191265 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191268 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191270 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191273 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191275 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191278 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191281 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191283 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191286 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191289 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191291 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191298 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191301 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:12:57.195848 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191304 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191306 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191309 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191312 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191314 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191317 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191319 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191322 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191324 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191327 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191329 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191332 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191335 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191337 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191340 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191342 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191345 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191349 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191353 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:12:57.196350 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191355 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.191358 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191433 2547 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191444 2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191452 2547 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191459 2547 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191466 2547 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191471 2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191477 2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191482 2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191486 2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191490 2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191494 2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191497 2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191500 2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191504 2547 flags.go:64] FLAG: --cgroup-root="" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191506 2547 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191510 2547 flags.go:64] FLAG: --client-ca-file="" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191514 2547 flags.go:64] FLAG: --cloud-provider="external" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191517 2547 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191521 2547 flags.go:64] FLAG: --cluster-domain="" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191524 2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191527 2547 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191531 2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 03:12:57.196815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191535 2547 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191538 2547 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191541 2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191544 2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191548 2547 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191551 2547 flags.go:64] FLAG: --contention-profiling="false" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191554 2547 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191557 2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191560 2547 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191563 2547 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191567 2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191570 2547 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191572 2547 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191575 2547 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191578 2547 flags.go:64] FLAG: --enable-server="true" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191588 2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191596 2547 flags.go:64] FLAG: --event-burst="100" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191599 2547 flags.go:64] FLAG: --event-qps="50" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191601 2547 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191606 2547 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191609 2547 flags.go:64] FLAG: --eviction-hard="" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191613 2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191616 2547 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191619 2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191622 2547 flags.go:64] FLAG: --eviction-soft="" Jun 14 03:12:57.197396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191629 2547 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191632 2547 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191635 2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191638 2547 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191641 2547 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191644 2547 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191647 2547 flags.go:64] FLAG: --feature-gates="" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191650 2547 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191653 2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191656 2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191660 2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191663 2547 flags.go:64] FLAG: --healthz-port="10248" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191665 2547 flags.go:64] FLAG: --help="false" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191668 2547 flags.go:64] FLAG: --hostname-override="ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191671 2547 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191674 2547 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191677 2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191680 2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191684 2547 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191686 2547 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191689 2547 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191692 2547 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191695 2547 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 03:12:57.197996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191705 2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191708 2547 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191711 2547 flags.go:64] FLAG: --kube-reserved="" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191715 2547 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191718 2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191721 2547 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191724 2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191727 2547 flags.go:64] FLAG: --lock-file="" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191730 2547 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191733 2547 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191736 2547 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191741 2547 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191745 2547 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191747 2547 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191750 2547 flags.go:64] FLAG: --logging-format="text" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191753 2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191757 2547 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191759 2547 flags.go:64] FLAG: --manifest-url="" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191762 2547 flags.go:64] FLAG: --manifest-url-header="" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191766 2547 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191769 2547 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191774 2547 flags.go:64] FLAG: --max-pods="110" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191776 2547 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191780 2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191783 2547 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 03:12:57.198608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191786 2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191789 2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191791 2547 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191794 2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191815 2547 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191818 2547 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191821 2547 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191825 2547 flags.go:64] FLAG: --pod-cidr="" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191834 2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191840 2547 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191845 2547 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191848 2547 flags.go:64] FLAG: --pods-per-core="0" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191851 2547 flags.go:64] FLAG: --port="10250" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191854 2547 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191858 2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07ac1631415c2f8c7" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191861 2547 flags.go:64] FLAG: --qos-reserved="" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191864 2547 flags.go:64] FLAG: --read-only-port="10255" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191867 2547 flags.go:64] FLAG: --register-node="true" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191870 2547 flags.go:64] FLAG: --register-with-taints="" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191873 2547 flags.go:64] FLAG: --registry-burst="10" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191876 2547 flags.go:64] FLAG: --registry-qps="5" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191879 2547 flags.go:64] FLAG: --reserved-cpus="" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191882 2547 flags.go:64] FLAG: --reserved-memory="" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191885 2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191888 2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 03:12:57.199285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191891 2547 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191895 2547 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191898 2547 flags.go:64] FLAG: --runonce="false" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191900 2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191903 2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191906 2547 flags.go:64] FLAG: --seccomp-default="false" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191909 2547 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191912 2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191915 2547 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191918 2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191921 2547 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191924 2547 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191927 2547 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191929 2547 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191932 2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191936 2547 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191945 2547 flags.go:64] FLAG: --system-cgroups="" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191949 2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191955 2547 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191958 2547 flags.go:64] FLAG: --tls-cert-file="" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191961 2547 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191966 2547 flags.go:64] FLAG: --tls-min-version="" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191969 2547 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191971 2547 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191974 2547 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 03:12:57.199954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191977 2547 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191980 2547 flags.go:64] FLAG: --v="2" Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191984 2547 flags.go:64] FLAG: --version="false" Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191988 2547 flags.go:64] FLAG: --vmodule="" Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191992 2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.191996 2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192144 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192148 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192151 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192155 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192157 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192160 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192164 2547 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192166 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192169 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192172 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192175 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192178 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192181 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192183 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192186 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:12:57.200556 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192189 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192193 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192196 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192199 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192202 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192205 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192208 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192210 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192213 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192216 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192219 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192221 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192224 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192226 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192229 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192231 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192234 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192237 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192239 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192242 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:12:57.201082 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192245 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192248 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192251 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192253 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192256 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192258 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192261 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192263 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192266 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192268 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192271 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192274 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192276 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192281 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192285 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192288 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192292 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192295 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192298 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:12:57.201590 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192301 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192304 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192306 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192309 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192311 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192314 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192317 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192319 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192322 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192326 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192330 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192332 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192335 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192338 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192340 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192343 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192346 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192348 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192351 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:12:57.202081 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192354 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192356 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192359 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192361 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192364 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192367 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192369 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192373 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192376 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192379 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192381 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192385 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192387 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192390 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192393 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192396 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192398 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192401 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192404 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192406 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:12:57.202555 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192409 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192412 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192414 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192418 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192421 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.192426 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.193305 2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.199945 2547 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.199960 2547 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.199975 2547 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.199981 2547 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200038 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200043 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200046 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:12:57.203072 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200050 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200053 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200056 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200059 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200062 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200065 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200068 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200070 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200073 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200076 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200078 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200082 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200084 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200087 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200090 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200092 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200095 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200098 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200100 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200103 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:12:57.203435 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200106 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200108 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200111 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200114 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200117 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200119 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200123 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200126 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200129 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200131 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200135 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200139 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200143 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200146 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200149 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200152 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200155 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200158 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200161 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:12:57.203931 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200164 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200166 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200169 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200173 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200175 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200178 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200182 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200185 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200189 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200192 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200194 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200197 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200200 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200203 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200206 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200209 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200212 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200216 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200219 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:12:57.204482 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200223 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200226 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200228 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200231 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200234 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200236 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200239 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200241 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200244 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200246 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200249 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200252 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200254 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200257 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200260 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200262 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200264 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200267 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200270 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200272 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:12:57.205246 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200275 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200278 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200281 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200283 2547 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200286 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200288 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200291 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200294 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200296 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200299 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200302 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200304 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200307 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200310 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200313 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200315 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200318 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:12:57.205964 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200321 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.200326 2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200442 2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200448 2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200451 2547 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200455 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200458 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200461 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200464 2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200467 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200469 2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200472 2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200474 2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200477 2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200480 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 03:12:57.206379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200483 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200485 2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200489 2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200493 2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200496 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200499 2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200502 2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200506 2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200508 2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200511 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200514 2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200517 2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200519 2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200523 2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200525 2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200529 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200532 2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200534 2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200537 2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 03:12:57.206782 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200539 2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200542 2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200545 2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200547 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200550 2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200552 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200555 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200557 2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200560 2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200563 2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200565 2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200568 2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200571 2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200574 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200577 2547 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200579 2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200582 2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200585 2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200587 2547 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200590 2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 03:12:57.207265 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200592 2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200595 2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200597 2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200600 2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200603 2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200605 2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200608 2547 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200611 2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200615 2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200619 2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200622 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200625 2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200629 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200632 2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200635 2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200638 2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200641 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200643 2547 feature_gate.go:328] unrecognized feature gate: Example Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200646 2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 03:12:57.207736 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200648 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200651 2547 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200653 2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200656 2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200658 2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200661 2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200663 2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200666 2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200669 2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200671 2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200674 2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200677 2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200679 2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200682 2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200684 2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200687 2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200689 2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200692 2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200695 2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200697 2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 03:12:57.208222 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200700 2547 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200703 2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200705 2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200708 2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200711 2547 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200714 2547 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200716 2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:57.200719 2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.200724 2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.200848 2547 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.204418 2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.207938 2547 server.go:1019] "Starting client certificate rotation" Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.208039 2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 03:12:57.208702 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.208083 2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 03:12:57.210621 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.210600 2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 03:12:57.211943 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.211927 2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 03:12:57.220734 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.220718 2547 log.go:25] "Validated CRI v1 runtime API" Jun 14 03:12:57.224848 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.224831 2547 log.go:25] "Validated CRI v1 image API" Jun 14 03:12:57.225617 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.225600 2547 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 03:12:57.228566 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.228543 2547 fs.go:135] Filesystem UUIDs: map[17ea0279-447a-49f1-84a3-46372fea5334:/dev/nvme0n1p3 22a8ea4a-827f-4b2f-82de-200b9259be37:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 14 03:12:57.228645 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.228564 2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 03:12:57.235095 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.234986 2547 manager.go:216] Machine: {Timestamp:2026-06-14 03:12:57.233679628 +0000 UTC m=+0.349293817 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099599 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c39d4089ea7eae6c03e18646f1b24 SystemUUID:ec2c39d4-089e-a7ea-e6c0-3e18646f1b24 BootID:6f4d0778-c536-4b65-8385-398f030ffa20 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:a9:f1:8f:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:a9:f1:8f:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:e5:53:bb:fa:f9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 03:12:57.235095 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.235086 2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 03:12:57.235302 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.235133 2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 03:12:57.235302 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.235189 2547 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 03:12:57.238114 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.238089 2547 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 03:12:57.238245 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.238118 2547 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-82.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 03:12:57.238820 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.238810 2547 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 03:12:57.238859 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.238823 2547 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 03:12:57.238859 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.238831 2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 03:12:57.239580 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.239571 2547 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 03:12:57.240966 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.240956 2547 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 03:12:57.243650 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.243639 2547 state_mem.go:36] "Initialized new in-memory state store" Jun 14 03:12:57.243790 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.243780 2547 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 03:12:57.243837 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.243824 2547 kubelet.go:486] "Attempting to sync node with API server" Jun 14 03:12:57.243866 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.243847 2547 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 03:12:57.243893 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.243867 2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 03:12:57.243893 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.243880 2547 kubelet.go:398] "Adding apiserver pod source" Jun 14 03:12:57.243942 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.243897 2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 03:12:57.244297 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.244284 2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 03:12:57.244377 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.244303 2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 03:12:57.249372 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.249354 2547 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 03:12:57.250777 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.250765 2547 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 03:12:57.250838 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.250795 2547 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 03:12:57.250993 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.250982 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 03:12:57.251027 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.250998 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 03:12:57.251027 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251003 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 03:12:57.251027 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251010 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 03:12:57.251027 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251018 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 03:12:57.251027 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251024 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 03:12:57.251707 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251698 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 03:12:57.251736 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251707 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 03:12:57.251736 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251714 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 03:12:57.251736 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251720 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 03:12:57.251736 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251728 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 03:12:57.251736 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251737 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 03:12:57.251879 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251758 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 03:12:57.251879 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.251764 2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 03:12:57.253174 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.253146 2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 03:12:57.253248 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.253219 2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 03:12:57.254952 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.254939 2547 server.go:1268] "Started kubelet" Jun 14 03:12:57.255016 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.254959 2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kjsq" Jun 14 03:12:57.255016 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.254995 2547 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 03:12:57.255093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.255041 2547 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 03:12:57.255093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.255032 2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 03:12:57.255716 ip-10-0-137-82 systemd[1]: Started Kubernetes Kubelet. Jun 14 03:12:57.256789 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.256771 2547 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 03:12:57.257534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.257520 2547 server.go:310] "Adding debug handlers to kubelet server" Jun 14 03:12:57.262250 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.262234 2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kjsq" Jun 14 03:12:57.262726 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.262711 2547 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 03:12:57.262928 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.262914 2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 03:12:57.263008 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.262917 2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 03:12:57.263058 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.263042 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:57.263238 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.263218 2547 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-82.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 03:12:57.263636 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.263623 2547 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 03:12:57.263718 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.263663 2547 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 03:12:57.263772 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.263624 2547 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 03:12:57.263873 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.263795 2547 reconstruct.go:97] "Volume reconstruction finished" Jun 14 03:12:57.263873 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.263819 2547 reconciler.go:29] "Reconciler: start to sync state" Jun 14 03:12:57.264264 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.264217 2547 factory.go:55] Registering systemd factory Jun 14 03:12:57.264264 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.264256 2547 factory.go:223] Registration of the systemd container factory successfully Jun 14 03:12:57.264558 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.263072 2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-82.ec2.internal.18b8d4068ec08d24 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-82.ec2.internal,UID:ip-10-0-137-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-82.ec2.internal,},FirstTimestamp:2026-06-14 03:12:57.254907172 +0000 UTC m=+0.370523373,LastTimestamp:2026-06-14 03:12:57.254907172 +0000 UTC m=+0.370523373,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-82.ec2.internal,}" Jun 14 03:12:57.264659 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.264617 2547 factory.go:153] Registering CRI-O factory Jun 14 03:12:57.264659 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.264631 2547 factory.go:223] Registration of the crio container factory successfully Jun 14 03:12:57.264777 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.264678 2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 03:12:57.264777 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.264702 2547 factory.go:103] Registering Raw factory Jun 14 03:12:57.264777 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.264716 2547 manager.go:1196] Started watching for new ooms in manager Jun 14 03:12:57.265306 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.265292 2547 manager.go:349] Starting recovery of all containers Jun 14 03:12:57.266652 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.266621 2547 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 14 03:12:57.266832 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.266786 2547 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 14 03:12:57.276664 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.276648 2547 manager.go:354] Recovery completed Jun 14 03:12:57.280717 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.280618 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:12:57.282471 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.282453 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:12:57.282535 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.282484 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:12:57.282535 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.282494 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:12:57.283001 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.282983 2547 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 03:12:57.283001 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.282999 2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 03:12:57.283102 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.282990 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:12:57.283102 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.283014 2547 state_mem.go:36] "Initialized new in-memory state store" Jun 14 03:12:57.283597 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.283584 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:12:57.283654 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.283610 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:12:57.283654 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.283624 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:12:57.284070 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.284059 2547 policy_none.go:49] "None policy: Start" Jun 14 03:12:57.284111 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.284073 2547 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 03:12:57.284111 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.284084 2547 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 03:12:57.284960 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.284950 2547 policy_none.go:47] "Start" Jun 14 03:12:57.321349 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.321335 2547 manager.go:337] "Starting Device Plugin manager" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.321365 2547 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.321374 2547 server.go:87] "Starting device plugin registration server" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.321588 2547 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.321599 2547 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.321684 2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.321758 2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.321767 2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.322424 2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.322469 2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.332713 2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.333822 2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.333855 2547 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.333873 2547 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 03:12:57.335361 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.333902 2547 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 03:12:57.336045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.335897 2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:12:57.421726 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.421696 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:12:57.422707 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.422690 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:12:57.422830 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.422720 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:12:57.422830 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.422732 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:12:57.422830 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.422756 2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.428178 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.428156 2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.428321 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.428181 2547 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-82.ec2.internal\": node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:57.434588 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.434525 2547 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal"] Jun 14 03:12:57.434588 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.434586 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:12:57.435312 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.435299 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:12:57.435383 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.435327 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:12:57.435383 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.435337 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:12:57.436521 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.436509 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:12:57.436612 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.436599 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.436648 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.436624 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:12:57.437202 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.437184 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:12:57.437289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.437189 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:12:57.437289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.437238 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:12:57.437289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.437250 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:12:57.437289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.437211 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:12:57.437289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.437283 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:12:57.438356 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.438341 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.438441 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.438370 2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 03:12:57.439041 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.439026 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientMemory" Jun 14 03:12:57.439119 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.439053 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 03:12:57.439119 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.439064 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeHasSufficientPID" Jun 14 03:12:57.446241 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.446226 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:57.464891 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.464871 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b84ec10b3cf9bbe02d0703faff068fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal\" (UID: \"2b84ec10b3cf9bbe02d0703faff068fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.464961 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.464894 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ba8465d2da51165232acdafa2e3a2b9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-82.ec2.internal\" (UID: \"0ba8465d2da51165232acdafa2e3a2b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.464961 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.464911 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b84ec10b3cf9bbe02d0703faff068fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal\" (UID: \"2b84ec10b3cf9bbe02d0703faff068fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.471399 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.471384 2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-82.ec2.internal\" not found" node="ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.475775 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.475761 2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-82.ec2.internal\" not found" node="ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.546567 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.546531 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:57.565720 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.565689 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b84ec10b3cf9bbe02d0703faff068fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal\" (UID: \"2b84ec10b3cf9bbe02d0703faff068fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.565720 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.565720 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b84ec10b3cf9bbe02d0703faff068fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal\" (UID: \"2b84ec10b3cf9bbe02d0703faff068fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.565937 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.565741 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ba8465d2da51165232acdafa2e3a2b9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-82.ec2.internal\" (UID: \"0ba8465d2da51165232acdafa2e3a2b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.565937 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.565791 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b84ec10b3cf9bbe02d0703faff068fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal\" (UID: \"2b84ec10b3cf9bbe02d0703faff068fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.565937 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.565790 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2b84ec10b3cf9bbe02d0703faff068fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal\" (UID: \"2b84ec10b3cf9bbe02d0703faff068fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.565937 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.565859 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ba8465d2da51165232acdafa2e3a2b9-config\") pod \"kube-apiserver-proxy-ip-10-0-137-82.ec2.internal\" (UID: \"0ba8465d2da51165232acdafa2e3a2b9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.647476 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.647442 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:57.748328 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.748259 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:57.773887 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.773858 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.779308 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:57.779292 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" Jun 14 03:12:57.849197 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.849166 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:57.949655 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:57.949625 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:58.050156 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:58.050088 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:58.150788 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:58.150762 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:58.155129 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.155108 2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:12:58.207194 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.207167 2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 03:12:58.207707 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.207317 2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 03:12:58.207707 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.207341 2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 03:12:58.248079 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:58.248044 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba8465d2da51165232acdafa2e3a2b9.slice/crio-85174eb52addc5721a2df4fe343ec17fe8f575b907bd211b7213e76296f1d5c4 WatchSource:0}: Error finding container 85174eb52addc5721a2df4fe343ec17fe8f575b907bd211b7213e76296f1d5c4: Status 404 returned error can't find the container with id 85174eb52addc5721a2df4fe343ec17fe8f575b907bd211b7213e76296f1d5c4 Jun 14 03:12:58.249531 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:12:58.249511 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b84ec10b3cf9bbe02d0703faff068fe.slice/crio-72c0bafb27f62e72a7246cd846146911354ed34b44bdc8c762915095cd71073a WatchSource:0}: Error finding container 72c0bafb27f62e72a7246cd846146911354ed34b44bdc8c762915095cd71073a: Status 404 returned error can't find the container with id 72c0bafb27f62e72a7246cd846146911354ed34b44bdc8c762915095cd71073a Jun 14 03:12:58.251692 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:58.251649 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:58.253880 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.253867 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 03:12:58.266527 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.266485 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 03:07:57 +0000 UTC" deadline="2027-12-14 12:50:01.802944979 +0000 UTC" Jun 14 03:12:58.266616 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.266527 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13161h37m3.536422253s" Jun 14 03:12:58.337191 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.337077 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal" event={"ID":"0ba8465d2da51165232acdafa2e3a2b9","Type":"ContainerStarted","Data":"85174eb52addc5721a2df4fe343ec17fe8f575b907bd211b7213e76296f1d5c4"} Jun 14 03:12:58.338060 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.338032 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" event={"ID":"2b84ec10b3cf9bbe02d0703faff068fe","Type":"ContainerStarted","Data":"72c0bafb27f62e72a7246cd846146911354ed34b44bdc8c762915095cd71073a"} Jun 14 03:12:58.352189 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:58.352165 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:58.452221 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.452194 2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:12:58.452221 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:58.452219 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:58.552411 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:58.552363 2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-82.ec2.internal\" not found" Jun 14 03:12:58.639073 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.638903 2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:12:58.664313 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.664281 2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal" Jun 14 03:12:58.675425 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.675395 2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 03:12:58.676544 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.676462 2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" Jun 14 03:12:58.690958 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:58.690929 2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 03:12:59.046866 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.046834 2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:12:59.244741 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.244659 2547 apiserver.go:52] "Watching apiserver" Jun 14 03:12:59.252478 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.252453 2547 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 03:12:59.252969 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.252944 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-qrjdh","openshift-image-registry/node-ca-qrlfx","openshift-network-diagnostics/network-check-target-tb2nl","openshift-ovn-kubernetes/ovnkube-node-zbx79","kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q","openshift-dns/node-resolver-slkjx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal","openshift-multus/multus-2mtgt","openshift-multus/multus-additional-cni-plugins-skzpc","openshift-multus/network-metrics-daemon-d6lrk","openshift-network-operator/iptables-alerter-w87dh","kube-system/global-pull-secret-syncer-x2pv9","kube-system/konnectivity-agent-2x29m"] Jun 14 03:12:59.254429 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.254409 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.255478 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.255455 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:12:59.255575 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.255552 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:12:59.256843 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.256826 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 03:12:59.257044 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.257024 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 03:12:59.257272 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.257253 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-htqj5\"" Jun 14 03:12:59.257575 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.257556 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:12:59.257661 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.257617 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:12:59.259131 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.259112 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.260360 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.260314 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:12:59.261099 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.261083 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 03:12:59.261198 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.261100 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 03:12:59.261647 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.261537 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.261844 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.261731 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7wk45\"" Jun 14 03:12:59.262784 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.262426 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 03:12:59.262784 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.262647 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 03:12:59.262784 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.262671 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-clcd4\"" Jun 14 03:12:59.262784 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.262762 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 03:12:59.263331 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.262864 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 03:12:59.263331 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.262895 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 03:12:59.263331 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.262916 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 03:12:59.263331 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.263140 2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 03:12:59.263789 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.263681 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 03:12:59.263789 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.263694 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kg9b9\"" Jun 14 03:12:59.263789 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.263685 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 03:12:59.264272 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.264170 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.266820 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.265870 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 03:12:59.266820 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.266324 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 03:12:59.266820 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.266555 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 03:12:59.266820 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.266727 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 03:12:59.267115 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.267095 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 03:12:59.268009 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.267766 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:12:59.268009 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.267948 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:12:59.268159 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.268021 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2hqcv\"" Jun 14 03:12:59.269355 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.269335 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.270773 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.270756 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.271353 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.271331 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 03:12:59.271744 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.271721 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 03:12:59.271856 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.271829 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t9jm2\"" Jun 14 03:12:59.271920 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.271866 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 03:12:59.272247 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.272228 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.273375 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.273356 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 03:12:59.273516 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.273489 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.273636 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.273595 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 03:12:59.274006 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.273987 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7t2cz\"" Jun 14 03:12:59.274403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.274372 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 03:12:59.274571 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.274554 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hrh6m\"" Jun 14 03:12:59.274734 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.274717 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 03:12:59.275631 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275404 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-var-lib-kubelet\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.275631 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275446 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-run-ovn\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.275631 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275472 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-var-lib-cni-multus\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.275631 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275496 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-run-multus-certs\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.275631 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275520 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w646d\" (UniqueName: \"kubernetes.io/projected/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-kube-api-access-w646d\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.275631 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275563 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-var-lib-openvswitch\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.275631 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275591 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-run-openvswitch\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.275631 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275617 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-ovnkube-config\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.275631 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275623 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275642 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27d18006-e419-4f76-8273-9c5959153118-agent-certs\") pod \"konnectivity-agent-2x29m\" (UID: \"27d18006-e419-4f76-8273-9c5959153118\") " pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275664 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-run-netns\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275687 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-var-lib-cni-bin\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275730 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-daemon-config\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275756 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-run-netns\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275779 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275821 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275847 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-ovn-node-metrics-cert\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275873 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49qfc\" (UniqueName: \"kubernetes.io/projected/ece5ab3c-1b05-4071-a849-e437253af84f-kube-api-access-49qfc\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275896 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-sys-fs\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275920 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95jp2\" (UniqueName: \"kubernetes.io/projected/2f4685d5-520b-4fad-bb63-a3020ec632a1-kube-api-access-95jp2\") pod \"node-resolver-slkjx\" (UID: \"2f4685d5-520b-4fad-bb63-a3020ec632a1\") " pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275949 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-systemd-units\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.275979 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-slash\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276004 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-etc-openvswitch\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276023 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-node-log\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276050 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-log-socket\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276073 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-cni-netd\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276110 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276131 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f4685d5-520b-4fad-bb63-a3020ec632a1-tmp-dir\") pod \"node-resolver-slkjx\" (UID: \"2f4685d5-520b-4fad-bb63-a3020ec632a1\") " pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276149 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-cni-bin\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276172 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-ovnkube-script-lib\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276211 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27d18006-e419-4f76-8273-9c5959153118-konnectivity-ca\") pod \"konnectivity-agent-2x29m\" (UID: \"27d18006-e419-4f76-8273-9c5959153118\") " pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276241 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4fl\" (UniqueName: \"kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl\") pod \"network-check-target-tb2nl\" (UID: \"4ce4318a-11be-4ff3-80e4-81110e91667b\") " pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276273 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-registration-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276294 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-device-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276319 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-system-cni-dir\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276352 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-env-overrides\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276379 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-socket-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276401 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-hostroot\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276423 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-conf-dir\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276448 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-etc-kubernetes\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.276781 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276487 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f4685d5-520b-4fad-bb63-a3020ec632a1-hosts-file\") pod \"node-resolver-slkjx\" (UID: \"2f4685d5-520b-4fad-bb63-a3020ec632a1\") " pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276519 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-kubelet\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276558 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jthp4\" (UniqueName: \"kubernetes.io/projected/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-kube-api-access-jthp4\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276586 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276606 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276638 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29zz5\" (UniqueName: \"kubernetes.io/projected/25581579-bf17-446e-933e-a94c0f64f0f3-kube-api-access-29zz5\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276663 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-cni-dir\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276685 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-run-systemd\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276707 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-cnibin\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276728 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-os-release\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276737 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276750 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-cni-binary-copy\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276772 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-socket-dir-parent\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276794 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-run-k8s-cni-cncf-io\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.277577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.276919 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 03:12:59.278143 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.277623 2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 03:12:59.278775 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.278757 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hbd4f\"" Jun 14 03:12:59.301340 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.301318 2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wrd4m" Jun 14 03:12:59.307568 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.307550 2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wrd4m" Jun 14 03:12:59.365091 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.365068 2547 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 03:12:59.377309 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377285 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-run-openvswitch\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.377309 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377311 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27d18006-e419-4f76-8273-9c5959153118-agent-certs\") pod \"konnectivity-agent-2x29m\" (UID: \"27d18006-e419-4f76-8273-9c5959153118\") " pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377330 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-systemd\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377349 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377365 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-ovn-node-metrics-cert\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377381 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qfc\" (UniqueName: \"kubernetes.io/projected/ece5ab3c-1b05-4071-a849-e437253af84f-kube-api-access-49qfc\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377401 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-sys-fs\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377408 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-run-openvswitch\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377423 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-lib-modules\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377450 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377459 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d746952d-090b-4847-b215-57c2cc49a738-host\") pod \"node-ca-qrlfx\" (UID: \"d746952d-090b-4847-b215-57c2cc49a738\") " pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377483 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-cnibin\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377501 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-sys-fs\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.377515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377516 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glv7t\" (UniqueName: \"kubernetes.io/projected/afa64b2b-aefd-45ef-83c2-d6b12442466f-kube-api-access-glv7t\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377536 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-systemd-units\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377562 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-slash\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377592 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-systemd-units\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377618 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-node-log\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377646 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-slash\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377673 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-log-socket\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377698 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-cni-netd\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377720 2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377750 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4fl\" (UniqueName: \"kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl\") pod \"network-check-target-tb2nl\" (UID: \"4ce4318a-11be-4ff3-80e4-81110e91667b\") " pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377758 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-node-log\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377783 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-log-socket\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377789 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-system-cni-dir\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377833 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-modprobe-d\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377831 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-cni-netd\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377854 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-cni-bin\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377874 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-var-lib-kubelet\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377895 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afa64b2b-aefd-45ef-83c2-d6b12442466f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.378093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377920 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8578348-6f58-4a49-a01a-095586531729-host-slash\") pod \"iptables-alerter-w87dh\" (UID: \"b8578348-6f58-4a49-a01a-095586531729\") " pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377933 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-cni-bin\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377938 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75593b11-91aa-4a6a-843b-cfb6d38be68d-dbus\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377897 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-system-cni-dir\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.377973 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-env-overrides\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378005 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-hostroot\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378133 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-etc-kubernetes\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378142 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-hostroot\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378163 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-sysconfig\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378187 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-tuned\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378210 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-system-cni-dir\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378237 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-etc-kubernetes\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378251 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378299 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f4685d5-520b-4fad-bb63-a3020ec632a1-hosts-file\") pod \"node-resolver-slkjx\" (UID: \"2f4685d5-520b-4fad-bb63-a3020ec632a1\") " pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378377 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f4685d5-520b-4fad-bb63-a3020ec632a1-hosts-file\") pod \"node-resolver-slkjx\" (UID: \"2f4685d5-520b-4fad-bb63-a3020ec632a1\") " pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378326 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jthp4\" (UniqueName: \"kubernetes.io/projected/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-kube-api-access-jthp4\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378430 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-daemon-config\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378456 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-env-overrides\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.379209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378537 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d746952d-090b-4847-b215-57c2cc49a738-serviceca\") pod \"node-ca-qrlfx\" (UID: \"d746952d-090b-4847-b215-57c2cc49a738\") " pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378632 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afa64b2b-aefd-45ef-83c2-d6b12442466f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378713 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-run-systemd\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378793 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-run-systemd\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378860 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-socket-dir-parent\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378898 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-var-lib-kubelet\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378953 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-socket-dir-parent\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378969 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-daemon-config\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378969 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-var-lib-kubelet\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.378992 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-run-multus-certs\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379016 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-kubernetes\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379025 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-run-multus-certs\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379030 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-run\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379072 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kcmq\" (UniqueName: \"kubernetes.io/projected/d746952d-090b-4847-b215-57c2cc49a738-kube-api-access-6kcmq\") pod \"node-ca-qrlfx\" (UID: \"d746952d-090b-4847-b215-57c2cc49a738\") " pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379090 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-run-ovn\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379119 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-var-lib-cni-multus\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379143 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-var-lib-openvswitch\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379169 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-ovnkube-config\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379177 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-run-ovn\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379191 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-var-lib-cni-bin\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379204 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-var-lib-cni-multus\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379211 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-sysctl-d\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379230 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-var-lib-openvswitch\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379247 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-os-release\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379277 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-var-lib-cni-bin\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379305 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-run-netns\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379330 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379363 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-run-netns\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379362 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afa64b2b-aefd-45ef-83c2-d6b12442466f-cni-binary-copy\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379390 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95jp2\" (UniqueName: \"kubernetes.io/projected/2f4685d5-520b-4fad-bb63-a3020ec632a1-kube-api-access-95jp2\") pod \"node-resolver-slkjx\" (UID: \"2f4685d5-520b-4fad-bb63-a3020ec632a1\") " pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379398 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379405 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-etc-openvswitch\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379429 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-etc-openvswitch\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379433 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:12:59.380946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379459 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-registration-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379483 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-device-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379506 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-cni-dir\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379529 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-run-netns\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379555 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krhff\" (UniqueName: \"kubernetes.io/projected/678faa51-bf06-4542-a85f-3a05d5ca5dd7-kube-api-access-krhff\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379582 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f4685d5-520b-4fad-bb63-a3020ec632a1-tmp-dir\") pod \"node-resolver-slkjx\" (UID: \"2f4685d5-520b-4fad-bb63-a3020ec632a1\") " pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379605 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-device-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379606 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-ovnkube-script-lib\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379635 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27d18006-e419-4f76-8273-9c5959153118-konnectivity-ca\") pod \"konnectivity-agent-2x29m\" (UID: \"27d18006-e419-4f76-8273-9c5959153118\") " pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379665 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-ovnkube-config\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379674 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-sysctl-conf\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379696 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75593b11-91aa-4a6a-843b-cfb6d38be68d-kubelet-config\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379712 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-cni-dir\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379727 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-run-netns\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379749 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-socket-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.379768 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379774 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-conf-dir\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379819 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsmdd\" (UniqueName: \"kubernetes.io/projected/b8578348-6f58-4a49-a01a-095586531729-kube-api-access-nsmdd\") pod \"iptables-alerter-w87dh\" (UID: \"b8578348-6f58-4a49-a01a-095586531729\") " pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.381556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379848 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-kubelet\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.379875 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs podName:ece5ab3c-1b05-4071-a849-e437253af84f nodeName:}" failed. No retries permitted until 2026-06-14 03:12:59.879848821 +0000 UTC m=+2.995462998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs") pod "network-metrics-daemon-d6lrk" (UID: "ece5ab3c-1b05-4071-a849-e437253af84f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379887 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-host-kubelet\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379902 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379921 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379938 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29zz5\" (UniqueName: \"kubernetes.io/projected/25581579-bf17-446e-933e-a94c0f64f0f3-kube-api-access-29zz5\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379953 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-run-k8s-cni-cncf-io\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379971 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-socket-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380016 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f4685d5-520b-4fad-bb63-a3020ec632a1-tmp-dir\") pod \"node-resolver-slkjx\" (UID: \"2f4685d5-520b-4fad-bb63-a3020ec632a1\") " pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380015 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-multus-conf-dir\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380037 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-registration-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.379975 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-sys\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380078 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8578348-6f58-4a49-a01a-095586531729-iptables-alerter-script\") pod \"iptables-alerter-w87dh\" (UID: \"b8578348-6f58-4a49-a01a-095586531729\") " pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380103 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-cnibin\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380128 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-os-release\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380133 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.382096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380151 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-cni-binary-copy\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380182 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-host\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380211 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w646d\" (UniqueName: \"kubernetes.io/projected/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-kube-api-access-w646d\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380251 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/678faa51-bf06-4542-a85f-3a05d5ca5dd7-tmp\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380275 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380482 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/25581579-bf17-446e-933e-a94c0f64f0f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380562 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27d18006-e419-4f76-8273-9c5959153118-konnectivity-ca\") pod \"konnectivity-agent-2x29m\" (UID: \"27d18006-e419-4f76-8273-9c5959153118\") " pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380647 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-host-run-k8s-cni-cncf-io\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380647 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-cni-binary-copy\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380695 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-cnibin\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380697 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-ovnkube-script-lib\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.380745 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-os-release\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.381540 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-ovn-node-metrics-cert\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.382608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.381625 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27d18006-e419-4f76-8273-9c5959153118-agent-certs\") pod \"konnectivity-agent-2x29m\" (UID: \"27d18006-e419-4f76-8273-9c5959153118\") " pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:12:59.387953 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.387933 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:12:59.388031 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.387957 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:12:59.388031 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.387970 2547 projected.go:196] Error preparing data for projected volume kube-api-access-fs4fl for pod openshift-network-diagnostics/network-check-target-tb2nl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:12:59.388031 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.388025 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl podName:4ce4318a-11be-4ff3-80e4-81110e91667b nodeName:}" failed. No retries permitted until 2026-06-14 03:12:59.888011488 +0000 UTC m=+3.003625687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fs4fl" (UniqueName: "kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl") pod "network-check-target-tb2nl" (UID: "4ce4318a-11be-4ff3-80e4-81110e91667b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:12:59.390613 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.390582 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29zz5\" (UniqueName: \"kubernetes.io/projected/25581579-bf17-446e-933e-a94c0f64f0f3-kube-api-access-29zz5\") pod \"aws-ebs-csi-driver-node-h4v8q\" (UID: \"25581579-bf17-446e-933e-a94c0f64f0f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.390712 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.390690 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49qfc\" (UniqueName: \"kubernetes.io/projected/ece5ab3c-1b05-4071-a849-e437253af84f-kube-api-access-49qfc\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:12:59.390774 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.390734 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w646d\" (UniqueName: \"kubernetes.io/projected/1a93097b-1f10-45a1-a343-61bfb0f2a0f6-kube-api-access-w646d\") pod \"multus-2mtgt\" (UID: \"1a93097b-1f10-45a1-a343-61bfb0f2a0f6\") " pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.391384 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.391357 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95jp2\" (UniqueName: \"kubernetes.io/projected/2f4685d5-520b-4fad-bb63-a3020ec632a1-kube-api-access-95jp2\") pod \"node-resolver-slkjx\" (UID: \"2f4685d5-520b-4fad-bb63-a3020ec632a1\") " pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.391440 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.391386 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jthp4\" (UniqueName: \"kubernetes.io/projected/9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba-kube-api-access-jthp4\") pod \"ovnkube-node-zbx79\" (UID: \"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.480998 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.480966 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d746952d-090b-4847-b215-57c2cc49a738-serviceca\") pod \"node-ca-qrlfx\" (UID: \"d746952d-090b-4847-b215-57c2cc49a738\") " pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.481162 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481010 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afa64b2b-aefd-45ef-83c2-d6b12442466f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.481162 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481047 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-kubernetes\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.481162 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481068 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-run\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.481162 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481091 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kcmq\" (UniqueName: \"kubernetes.io/projected/d746952d-090b-4847-b215-57c2cc49a738-kube-api-access-6kcmq\") pod \"node-ca-qrlfx\" (UID: \"d746952d-090b-4847-b215-57c2cc49a738\") " pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.481162 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481115 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-sysctl-d\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.481162 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481133 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-run\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481164 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-kubernetes\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481142 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-os-release\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481212 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-os-release\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481225 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afa64b2b-aefd-45ef-83c2-d6b12442466f-cni-binary-copy\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481262 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krhff\" (UniqueName: \"kubernetes.io/projected/678faa51-bf06-4542-a85f-3a05d5ca5dd7-kube-api-access-krhff\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481280 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-sysctl-conf\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481297 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75593b11-91aa-4a6a-843b-cfb6d38be68d-kubelet-config\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481314 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsmdd\" (UniqueName: \"kubernetes.io/projected/b8578348-6f58-4a49-a01a-095586531729-kube-api-access-nsmdd\") pod \"iptables-alerter-w87dh\" (UID: \"b8578348-6f58-4a49-a01a-095586531729\") " pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481324 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-sysctl-d\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481385 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-sys\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481399 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75593b11-91aa-4a6a-843b-cfb6d38be68d-kubelet-config\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481333 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-sys\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.481452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481424 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-sysctl-conf\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481446 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8578348-6f58-4a49-a01a-095586531729-iptables-alerter-script\") pod \"iptables-alerter-w87dh\" (UID: \"b8578348-6f58-4a49-a01a-095586531729\") " pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481495 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-host\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481521 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/678faa51-bf06-4542-a85f-3a05d5ca5dd7-tmp\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481545 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481580 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-systemd\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481585 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d746952d-090b-4847-b215-57c2cc49a738-serviceca\") pod \"node-ca-qrlfx\" (UID: \"d746952d-090b-4847-b215-57c2cc49a738\") " pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481605 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-lib-modules\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481611 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afa64b2b-aefd-45ef-83c2-d6b12442466f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481628 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d746952d-090b-4847-b215-57c2cc49a738-host\") pod \"node-ca-qrlfx\" (UID: \"d746952d-090b-4847-b215-57c2cc49a738\") " pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481654 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afa64b2b-aefd-45ef-83c2-d6b12442466f-cni-binary-copy\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481669 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-cnibin\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481685 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-host\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481700 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glv7t\" (UniqueName: \"kubernetes.io/projected/afa64b2b-aefd-45ef-83c2-d6b12442466f-kube-api-access-glv7t\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481745 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-modprobe-d\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481721 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d746952d-090b-4847-b215-57c2cc49a738-host\") pod \"node-ca-qrlfx\" (UID: \"d746952d-090b-4847-b215-57c2cc49a738\") " pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481773 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-var-lib-kubelet\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481774 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481779 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-lib-modules\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481813 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afa64b2b-aefd-45ef-83c2-d6b12442466f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481841 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8578348-6f58-4a49-a01a-095586531729-host-slash\") pod \"iptables-alerter-w87dh\" (UID: \"b8578348-6f58-4a49-a01a-095586531729\") " pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481787 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-cnibin\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481862 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75593b11-91aa-4a6a-843b-cfb6d38be68d-dbus\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481871 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-var-lib-kubelet\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481878 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-modprobe-d\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481902 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-sysconfig\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481921 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8578348-6f58-4a49-a01a-095586531729-host-slash\") pod \"iptables-alerter-w87dh\" (UID: \"b8578348-6f58-4a49-a01a-095586531729\") " pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481925 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8578348-6f58-4a49-a01a-095586531729-iptables-alerter-script\") pod \"iptables-alerter-w87dh\" (UID: \"b8578348-6f58-4a49-a01a-095586531729\") " pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481942 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-tuned\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481949 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75593b11-91aa-4a6a-843b-cfb6d38be68d-dbus\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481967 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-system-cni-dir\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481989 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-sysconfig\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.481995 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.482033 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afa64b2b-aefd-45ef-83c2-d6b12442466f-system-cni-dir\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.482074 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-systemd\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.482832 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.482096 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:12:59.483412 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.482162 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret podName:75593b11-91aa-4a6a-843b-cfb6d38be68d nodeName:}" failed. No retries permitted until 2026-06-14 03:12:59.982144117 +0000 UTC m=+3.097758295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret") pod "global-pull-secret-syncer-x2pv9" (UID: "75593b11-91aa-4a6a-843b-cfb6d38be68d") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:12:59.483412 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.482353 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afa64b2b-aefd-45ef-83c2-d6b12442466f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.484084 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.484041 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/678faa51-bf06-4542-a85f-3a05d5ca5dd7-etc-tuned\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.484203 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.484187 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/678faa51-bf06-4542-a85f-3a05d5ca5dd7-tmp\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.490554 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.490527 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kcmq\" (UniqueName: \"kubernetes.io/projected/d746952d-090b-4847-b215-57c2cc49a738-kube-api-access-6kcmq\") pod \"node-ca-qrlfx\" (UID: \"d746952d-090b-4847-b215-57c2cc49a738\") " pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.490554 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.490549 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsmdd\" (UniqueName: \"kubernetes.io/projected/b8578348-6f58-4a49-a01a-095586531729-kube-api-access-nsmdd\") pod \"iptables-alerter-w87dh\" (UID: \"b8578348-6f58-4a49-a01a-095586531729\") " pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.490951 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.490934 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glv7t\" (UniqueName: \"kubernetes.io/projected/afa64b2b-aefd-45ef-83c2-d6b12442466f-kube-api-access-glv7t\") pod \"multus-additional-cni-plugins-skzpc\" (UID: \"afa64b2b-aefd-45ef-83c2-d6b12442466f\") " pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.491073 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.491050 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krhff\" (UniqueName: \"kubernetes.io/projected/678faa51-bf06-4542-a85f-3a05d5ca5dd7-kube-api-access-krhff\") pod \"tuned-qrjdh\" (UID: \"678faa51-bf06-4542-a85f-3a05d5ca5dd7\") " pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.567976 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.567895 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-slkjx" Jun 14 03:12:59.574862 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.574845 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:12:59.582706 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.582690 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:12:59.588649 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.588629 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" Jun 14 03:12:59.595765 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.595742 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2mtgt" Jun 14 03:12:59.600709 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.600690 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qrlfx" Jun 14 03:12:59.607541 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.607514 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-skzpc" Jun 14 03:12:59.613920 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.613896 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" Jun 14 03:12:59.619870 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.619853 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w87dh" Jun 14 03:12:59.884988 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.884909 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:12:59.885119 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.885034 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:12:59.885119 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.885094 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs podName:ece5ab3c-1b05-4071-a849-e437253af84f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:00.885076217 +0000 UTC m=+4.000690432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs") pod "network-metrics-daemon-d6lrk" (UID: "ece5ab3c-1b05-4071-a849-e437253af84f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:12:59.985274 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.985241 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4fl\" (UniqueName: \"kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl\") pod \"network-check-target-tb2nl\" (UID: \"4ce4318a-11be-4ff3-80e4-81110e91667b\") " pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:12:59.985430 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:12:59.985283 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:12:59.985430 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.985397 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:12:59.985430 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.985413 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:12:59.985548 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.985432 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:12:59.985548 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.985445 2547 projected.go:196] Error preparing data for projected volume kube-api-access-fs4fl for pod openshift-network-diagnostics/network-check-target-tb2nl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:12:59.985548 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.985459 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret podName:75593b11-91aa-4a6a-843b-cfb6d38be68d nodeName:}" failed. No retries permitted until 2026-06-14 03:13:00.985441591 +0000 UTC m=+4.101055771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret") pod "global-pull-secret-syncer-x2pv9" (UID: "75593b11-91aa-4a6a-843b-cfb6d38be68d") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:12:59.985548 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:12:59.985480 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl podName:4ce4318a-11be-4ff3-80e4-81110e91667b nodeName:}" failed. No retries permitted until 2026-06-14 03:13:00.98546844 +0000 UTC m=+4.101082624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs4fl" (UniqueName: "kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl") pod "network-check-target-tb2nl" (UID: "4ce4318a-11be-4ff3-80e4-81110e91667b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:00.037235 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.037207 2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 03:13:00.053648 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:13:00.053620 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa64b2b_aefd_45ef_83c2_d6b12442466f.slice/crio-d3fd7720a06d7954e3804beb7973a4150764cdd502604d8be01a67cc62065505 WatchSource:0}: Error finding container d3fd7720a06d7954e3804beb7973a4150764cdd502604d8be01a67cc62065505: Status 404 returned error can't find the container with id d3fd7720a06d7954e3804beb7973a4150764cdd502604d8be01a67cc62065505 Jun 14 03:13:00.054945 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:13:00.054915 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678faa51_bf06_4542_a85f_3a05d5ca5dd7.slice/crio-13ff37b8ec83e133447839518273f29682af441bdb11c87c444634909a69d1ee WatchSource:0}: Error finding container 13ff37b8ec83e133447839518273f29682af441bdb11c87c444634909a69d1ee: Status 404 returned error can't find the container with id 13ff37b8ec83e133447839518273f29682af441bdb11c87c444634909a69d1ee Jun 14 03:13:00.057723 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:13:00.057699 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa2fcc0_2d83_41f7_adb4_87d3a3ff51ba.slice/crio-41aa11f6cdf1d1d8af3a5e8b0c8aa1f0591b4c9f23dbec138bb5ea3fd0c50538 WatchSource:0}: Error finding container 41aa11f6cdf1d1d8af3a5e8b0c8aa1f0591b4c9f23dbec138bb5ea3fd0c50538: Status 404 returned error can't find the container with id 41aa11f6cdf1d1d8af3a5e8b0c8aa1f0591b4c9f23dbec138bb5ea3fd0c50538 Jun 14 03:13:00.059770 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:13:00.059750 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8578348_6f58_4a49_a01a_095586531729.slice/crio-09b44cf4352c18e31a875d4bd02b13d76d7161237904ae7b48b3c0bb8de91cbe WatchSource:0}: Error finding container 09b44cf4352c18e31a875d4bd02b13d76d7161237904ae7b48b3c0bb8de91cbe: Status 404 returned error can't find the container with id 09b44cf4352c18e31a875d4bd02b13d76d7161237904ae7b48b3c0bb8de91cbe Jun 14 03:13:00.060477 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:13:00.060375 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd746952d_090b_4847_b215_57c2cc49a738.slice/crio-d5a8f772aa694a2c0bff5b5b2455043e8083dcf61c35f2eaf0f175e0da443669 WatchSource:0}: Error finding container d5a8f772aa694a2c0bff5b5b2455043e8083dcf61c35f2eaf0f175e0da443669: Status 404 returned error can't find the container with id d5a8f772aa694a2c0bff5b5b2455043e8083dcf61c35f2eaf0f175e0da443669 Jun 14 03:13:00.061904 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:13:00.061879 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25581579_bf17_446e_933e_a94c0f64f0f3.slice/crio-2f1a0a68c1f13d072ea49af2ab0dba4db9b54808540282dd5066d80a423e460f WatchSource:0}: Error finding container 2f1a0a68c1f13d072ea49af2ab0dba4db9b54808540282dd5066d80a423e460f: Status 404 returned error can't find the container with id 2f1a0a68c1f13d072ea49af2ab0dba4db9b54808540282dd5066d80a423e460f Jun 14 03:13:00.063983 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:13:00.063966 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d18006_e419_4f76_8273_9c5959153118.slice/crio-7cb8a8f8d60042e39a928b0c497478e841c6493b45ff35f46a1be4ac35bd59b9 WatchSource:0}: Error finding container 7cb8a8f8d60042e39a928b0c497478e841c6493b45ff35f46a1be4ac35bd59b9: Status 404 returned error can't find the container with id 7cb8a8f8d60042e39a928b0c497478e841c6493b45ff35f46a1be4ac35bd59b9 Jun 14 03:13:00.064446 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:13:00.064428 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a93097b_1f10_45a1_a343_61bfb0f2a0f6.slice/crio-18e8fa3fe46b538b99318e4c7d070e911831ec9eeda2f40b9df0ce2750983153 WatchSource:0}: Error finding container 18e8fa3fe46b538b99318e4c7d070e911831ec9eeda2f40b9df0ce2750983153: Status 404 returned error can't find the container with id 18e8fa3fe46b538b99318e4c7d070e911831ec9eeda2f40b9df0ce2750983153 Jun 14 03:13:00.066640 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:13:00.066264 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4685d5_520b_4fad_bb63_a3020ec632a1.slice/crio-a312d79f732df9af26252865b8eee24c256fe3df7b1e7695aa3c1a4f86e44d56 WatchSource:0}: Error finding container a312d79f732df9af26252865b8eee24c256fe3df7b1e7695aa3c1a4f86e44d56: Status 404 returned error can't find the container with id a312d79f732df9af26252865b8eee24c256fe3df7b1e7695aa3c1a4f86e44d56 Jun 14 03:13:00.309511 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.309338 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 03:07:59 +0000 UTC" deadline="2027-12-06 13:02:52.679671208 +0000 UTC" Jun 14 03:13:00.309511 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.309510 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12969h49m52.370164005s" Jun 14 03:13:00.334754 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.334726 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:00.334899 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:00.334875 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:00.343844 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.343813 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" event={"ID":"2b84ec10b3cf9bbe02d0703faff068fe","Type":"ContainerStarted","Data":"c791c68fae0121deada6136f61a4d4e55c371e24864542a965a73de89f4cf001"} Jun 14 03:13:00.345019 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.344990 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-slkjx" event={"ID":"2f4685d5-520b-4fad-bb63-a3020ec632a1","Type":"ContainerStarted","Data":"a312d79f732df9af26252865b8eee24c256fe3df7b1e7695aa3c1a4f86e44d56"} Jun 14 03:13:00.346048 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.346018 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2x29m" event={"ID":"27d18006-e419-4f76-8273-9c5959153118","Type":"ContainerStarted","Data":"7cb8a8f8d60042e39a928b0c497478e841c6493b45ff35f46a1be4ac35bd59b9"} Jun 14 03:13:00.347015 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.346993 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qrlfx" event={"ID":"d746952d-090b-4847-b215-57c2cc49a738","Type":"ContainerStarted","Data":"d5a8f772aa694a2c0bff5b5b2455043e8083dcf61c35f2eaf0f175e0da443669"} Jun 14 03:13:00.347972 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.347947 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w87dh" event={"ID":"b8578348-6f58-4a49-a01a-095586531729","Type":"ContainerStarted","Data":"09b44cf4352c18e31a875d4bd02b13d76d7161237904ae7b48b3c0bb8de91cbe"} Jun 14 03:13:00.348955 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.348935 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" event={"ID":"678faa51-bf06-4542-a85f-3a05d5ca5dd7","Type":"ContainerStarted","Data":"13ff37b8ec83e133447839518273f29682af441bdb11c87c444634909a69d1ee"} Jun 14 03:13:00.350137 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.350118 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal" event={"ID":"0ba8465d2da51165232acdafa2e3a2b9","Type":"ContainerStarted","Data":"ec167daf8ed4889018869ee930c1deaee41510bef8e9a7ad3c22a4fcf8fb2734"} Jun 14 03:13:00.351202 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.351177 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2mtgt" event={"ID":"1a93097b-1f10-45a1-a343-61bfb0f2a0f6","Type":"ContainerStarted","Data":"18e8fa3fe46b538b99318e4c7d070e911831ec9eeda2f40b9df0ce2750983153"} Jun 14 03:13:00.352169 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.352150 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" event={"ID":"25581579-bf17-446e-933e-a94c0f64f0f3","Type":"ContainerStarted","Data":"2f1a0a68c1f13d072ea49af2ab0dba4db9b54808540282dd5066d80a423e460f"} Jun 14 03:13:00.353121 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.353103 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" event={"ID":"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba","Type":"ContainerStarted","Data":"41aa11f6cdf1d1d8af3a5e8b0c8aa1f0591b4c9f23dbec138bb5ea3fd0c50538"} Jun 14 03:13:00.354016 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.353997 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skzpc" event={"ID":"afa64b2b-aefd-45ef-83c2-d6b12442466f","Type":"ContainerStarted","Data":"d3fd7720a06d7954e3804beb7973a4150764cdd502604d8be01a67cc62065505"} Jun 14 03:13:00.373727 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.373679 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-82.ec2.internal" podStartSLOduration=2.373667481 podStartE2EDuration="2.373667481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:00.373368223 +0000 UTC m=+3.488982421" watchObservedRunningTime="2026-06-14 03:13:00.373667481 +0000 UTC m=+3.489281679" Jun 14 03:13:00.894643 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.894566 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:00.894857 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:00.894742 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:00.894857 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:00.894833 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs podName:ece5ab3c-1b05-4071-a849-e437253af84f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:02.894796513 +0000 UTC m=+6.010410701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs") pod "network-metrics-daemon-d6lrk" (UID: "ece5ab3c-1b05-4071-a849-e437253af84f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:00.996166 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.996124 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:00.996349 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:00.996231 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4fl\" (UniqueName: \"kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl\") pod \"network-check-target-tb2nl\" (UID: \"4ce4318a-11be-4ff3-80e4-81110e91667b\") " pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:00.996411 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:00.996369 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:00.996411 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:00.996387 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:00.996411 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:00.996400 2547 projected.go:196] Error preparing data for projected volume kube-api-access-fs4fl for pod openshift-network-diagnostics/network-check-target-tb2nl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:00.996573 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:00.996459 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl podName:4ce4318a-11be-4ff3-80e4-81110e91667b nodeName:}" failed. No retries permitted until 2026-06-14 03:13:02.996439833 +0000 UTC m=+6.112054026 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs4fl" (UniqueName: "kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl") pod "network-check-target-tb2nl" (UID: "4ce4318a-11be-4ff3-80e4-81110e91667b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:00.996573 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:00.996531 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:00.996573 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:00.996567 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret podName:75593b11-91aa-4a6a-843b-cfb6d38be68d nodeName:}" failed. No retries permitted until 2026-06-14 03:13:02.996555701 +0000 UTC m=+6.112169895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret") pod "global-pull-secret-syncer-x2pv9" (UID: "75593b11-91aa-4a6a-843b-cfb6d38be68d") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:01.310510 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:01.310416 2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 03:07:59 +0000 UTC" deadline="2027-12-22 08:07:09.742011498 +0000 UTC" Jun 14 03:13:01.310510 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:01.310460 2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13348h54m8.43155662s" Jun 14 03:13:01.335208 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:01.335180 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:01.335354 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:01.335180 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:01.335354 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:01.335313 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:01.335354 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:01.335345 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:01.365442 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:01.365385 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" event={"ID":"2b84ec10b3cf9bbe02d0703faff068fe","Type":"ContainerDied","Data":"c791c68fae0121deada6136f61a4d4e55c371e24864542a965a73de89f4cf001"} Jun 14 03:13:01.366165 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:01.365353 2547 generic.go:356] "Generic (PLEG): container finished" podID="2b84ec10b3cf9bbe02d0703faff068fe" containerID="c791c68fae0121deada6136f61a4d4e55c371e24864542a965a73de89f4cf001" exitCode=0 Jun 14 03:13:02.334779 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:02.334744 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:02.335316 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:02.334909 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:02.397396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:02.397358 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" event={"ID":"2b84ec10b3cf9bbe02d0703faff068fe","Type":"ContainerStarted","Data":"e03a1a47e49355630e8eff272acf6343dd53fa418c72c02e46a418291546f2d4"} Jun 14 03:13:02.919767 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:02.919729 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:02.919956 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:02.919922 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:02.920030 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:02.919988 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs podName:ece5ab3c-1b05-4071-a849-e437253af84f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:06.919969629 +0000 UTC m=+10.035583812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs") pod "network-metrics-daemon-d6lrk" (UID: "ece5ab3c-1b05-4071-a849-e437253af84f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:03.020376 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:03.020339 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4fl\" (UniqueName: \"kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl\") pod \"network-check-target-tb2nl\" (UID: \"4ce4318a-11be-4ff3-80e4-81110e91667b\") " pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:03.020567 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:03.020396 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:03.020567 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:03.020511 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:03.020567 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:03.020533 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:03.020567 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:03.020560 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:03.020765 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:03.020574 2547 projected.go:196] Error preparing data for projected volume kube-api-access-fs4fl for pod openshift-network-diagnostics/network-check-target-tb2nl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:03.020765 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:03.020579 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret podName:75593b11-91aa-4a6a-843b-cfb6d38be68d nodeName:}" failed. No retries permitted until 2026-06-14 03:13:07.020562054 +0000 UTC m=+10.136176234 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret") pod "global-pull-secret-syncer-x2pv9" (UID: "75593b11-91aa-4a6a-843b-cfb6d38be68d") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:03.020765 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:03.020626 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl podName:4ce4318a-11be-4ff3-80e4-81110e91667b nodeName:}" failed. No retries permitted until 2026-06-14 03:13:07.020609611 +0000 UTC m=+10.136223793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs4fl" (UniqueName: "kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl") pod "network-check-target-tb2nl" (UID: "4ce4318a-11be-4ff3-80e4-81110e91667b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:03.334712 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:03.334682 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:03.334913 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:03.334828 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:03.334913 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:03.334682 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:03.335300 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:03.334944 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:04.335070 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:04.335036 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:04.335515 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:04.335171 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:05.334573 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:05.334387 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:05.334573 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:05.334434 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:05.334573 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:05.334538 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:05.335258 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:05.335020 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:06.334958 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:06.334927 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:06.335145 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:06.335065 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:06.957416 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:06.955322 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:06.957416 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:06.955515 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:06.957416 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:06.955598 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs podName:ece5ab3c-1b05-4071-a849-e437253af84f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:14.955576275 +0000 UTC m=+18.071190458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs") pod "network-metrics-daemon-d6lrk" (UID: "ece5ab3c-1b05-4071-a849-e437253af84f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:07.056659 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:07.056619 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4fl\" (UniqueName: \"kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl\") pod \"network-check-target-tb2nl\" (UID: \"4ce4318a-11be-4ff3-80e4-81110e91667b\") " pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:07.056866 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:07.056677 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:07.056866 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:07.056811 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:07.056866 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:07.056831 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:07.056866 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:07.056852 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:07.056866 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:07.056867 2547 projected.go:196] Error preparing data for projected volume kube-api-access-fs4fl for pod openshift-network-diagnostics/network-check-target-tb2nl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:07.057112 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:07.056891 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret podName:75593b11-91aa-4a6a-843b-cfb6d38be68d nodeName:}" failed. No retries permitted until 2026-06-14 03:13:15.056871029 +0000 UTC m=+18.172485207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret") pod "global-pull-secret-syncer-x2pv9" (UID: "75593b11-91aa-4a6a-843b-cfb6d38be68d") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:07.057112 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:07.056917 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl podName:4ce4318a-11be-4ff3-80e4-81110e91667b nodeName:}" failed. No retries permitted until 2026-06-14 03:13:15.05690216 +0000 UTC m=+18.172516350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs4fl" (UniqueName: "kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl") pod "network-check-target-tb2nl" (UID: "4ce4318a-11be-4ff3-80e4-81110e91667b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:07.336258 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:07.335551 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:07.336258 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:07.335661 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:07.336258 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:07.336080 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:07.336258 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:07.336169 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:08.335094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:08.335006 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:08.335553 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:08.335161 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:09.334971 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:09.334929 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:09.335157 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:09.334990 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:09.335157 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:09.335080 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:09.335537 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:09.335196 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:10.334770 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:10.334730 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:10.334959 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:10.334892 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:11.334468 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:11.334375 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:11.334468 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:11.334403 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:11.334971 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:11.334520 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:11.334971 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:11.334647 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:12.334461 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:12.334429 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:12.334628 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:12.334533 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:13.334792 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:13.334752 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:13.335251 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:13.334895 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:13.335251 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:13.334970 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:13.335251 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:13.335088 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:14.334314 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:14.334278 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:14.334572 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:14.334426 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:15.021195 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:15.021153 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:15.021588 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:15.021294 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:15.021588 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:15.021363 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs podName:ece5ab3c-1b05-4071-a849-e437253af84f nodeName:}" failed. No retries permitted until 2026-06-14 03:13:31.021343689 +0000 UTC m=+34.136957870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs") pod "network-metrics-daemon-d6lrk" (UID: "ece5ab3c-1b05-4071-a849-e437253af84f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:15.122224 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:15.122190 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4fl\" (UniqueName: \"kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl\") pod \"network-check-target-tb2nl\" (UID: \"4ce4318a-11be-4ff3-80e4-81110e91667b\") " pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:15.122224 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:15.122232 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:15.122444 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:15.122351 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:15.122444 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:15.122379 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:15.122444 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:15.122412 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:15.122444 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:15.122417 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret podName:75593b11-91aa-4a6a-843b-cfb6d38be68d nodeName:}" failed. No retries permitted until 2026-06-14 03:13:31.122402877 +0000 UTC m=+34.238017054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret") pod "global-pull-secret-syncer-x2pv9" (UID: "75593b11-91aa-4a6a-843b-cfb6d38be68d") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:15.122444 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:15.122425 2547 projected.go:196] Error preparing data for projected volume kube-api-access-fs4fl for pod openshift-network-diagnostics/network-check-target-tb2nl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:15.122674 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:15.122478 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl podName:4ce4318a-11be-4ff3-80e4-81110e91667b nodeName:}" failed. No retries permitted until 2026-06-14 03:13:31.122462127 +0000 UTC m=+34.238076308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs4fl" (UniqueName: "kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl") pod "network-check-target-tb2nl" (UID: "4ce4318a-11be-4ff3-80e4-81110e91667b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:15.334951 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:15.334862 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:15.335100 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:15.334862 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:15.335100 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:15.334982 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:15.335100 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:15.335045 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:16.334335 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:16.334288 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:16.334751 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:16.334446 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:17.335819 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:17.335770 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:17.336287 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:17.335914 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:17.336287 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:17.335952 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:17.336287 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:17.336017 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:18.334317 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:18.334286 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:18.334614 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:18.334421 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:19.334566 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.334311 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:19.335383 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:19.334672 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:19.335383 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.334337 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:19.335383 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:19.334772 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:19.436156 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.435945 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2mtgt" event={"ID":"1a93097b-1f10-45a1-a343-61bfb0f2a0f6","Type":"ContainerStarted","Data":"7e938dbcb78ed2c0cf2ec9111a79d0abff985c0a1d6656e2a68dbff9f41aeb5c"} Jun 14 03:13:19.437502 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.437478 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" event={"ID":"25581579-bf17-446e-933e-a94c0f64f0f3","Type":"ContainerStarted","Data":"83ead7282e46ec6bf31566d2140e299b82268a2761c0207f0ef2d4ec7c128ee6"} Jun 14 03:13:19.438878 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.438860 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:13:19.439258 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.439241 2547 generic.go:356] "Generic (PLEG): container finished" podID="9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba" containerID="93aadc3493d5a70a8397e3270aa05962b37a78cfd0a71f965c6667bad4ec6250" exitCode=1 Jun 14 03:13:19.439324 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.439306 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" event={"ID":"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba","Type":"ContainerDied","Data":"93aadc3493d5a70a8397e3270aa05962b37a78cfd0a71f965c6667bad4ec6250"} Jun 14 03:13:19.439375 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.439365 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" event={"ID":"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba","Type":"ContainerStarted","Data":"527c7fe0549f1273c6a3ffaafc5f0376ae9d611ab467367d004e54611ad15a69"} Jun 14 03:13:19.440917 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.440897 2547 generic.go:356] "Generic (PLEG): container finished" podID="afa64b2b-aefd-45ef-83c2-d6b12442466f" containerID="f5ac66c2435c81ebc84c838998d50166c52666f847d87ba81f66e4c3e3bffc7b" exitCode=0 Jun 14 03:13:19.440996 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.440965 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skzpc" event={"ID":"afa64b2b-aefd-45ef-83c2-d6b12442466f","Type":"ContainerDied","Data":"f5ac66c2435c81ebc84c838998d50166c52666f847d87ba81f66e4c3e3bffc7b"} Jun 14 03:13:19.442501 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.442421 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-slkjx" event={"ID":"2f4685d5-520b-4fad-bb63-a3020ec632a1","Type":"ContainerStarted","Data":"c366299caeaafaa9574cff2c5d078d55298c625cb78bfa49258d9a30309d9321"} Jun 14 03:13:19.444086 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.444046 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2x29m" event={"ID":"27d18006-e419-4f76-8273-9c5959153118","Type":"ContainerStarted","Data":"32811ff86bba4647456bcab2e0b15a4b46f0dcde3cad8e6b3a947d16d7de2901"} Jun 14 03:13:19.445613 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.445596 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qrlfx" event={"ID":"d746952d-090b-4847-b215-57c2cc49a738","Type":"ContainerStarted","Data":"a6bb599e60def8b6df515fa7e27fd7dc8ceef5375bc1d732bc42e3d09c31e0b8"} Jun 14 03:13:19.447046 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.447024 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" event={"ID":"678faa51-bf06-4542-a85f-3a05d5ca5dd7","Type":"ContainerStarted","Data":"b0a46a3702200fb62decd4b0cf77f659b6828c92f71f32f8286fe1fdf515c33a"} Jun 14 03:13:19.454080 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.453987 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-82.ec2.internal" podStartSLOduration=21.453974896 podStartE2EDuration="21.453974896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:02.413471611 +0000 UTC m=+5.529085818" watchObservedRunningTime="2026-06-14 03:13:19.453974896 +0000 UTC m=+22.569589125" Jun 14 03:13:19.454080 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.454064 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2mtgt" podStartSLOduration=3.4189913880000002 podStartE2EDuration="22.454055924s" totalImagesPullingTime="19.035064536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:19.453604612 +0000 UTC m=+22.569218811" watchObservedRunningTime="2026-06-14 03:13:19.454055924 +0000 UTC m=+22.569670124" Jun 14 03:13:19.470369 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.470320 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qrlfx" podStartSLOduration=3.450555438 podStartE2EDuration="22.470301744s" totalImagesPullingTime="19.019746306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:19.470280626 +0000 UTC m=+22.585894825" watchObservedRunningTime="2026-06-14 03:13:19.470301744 +0000 UTC m=+22.585915943" Jun 14 03:13:19.486038 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.485981 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2x29m" podStartSLOduration=11.802441352 podStartE2EDuration="22.485957788s" totalImagesPullingTime="10.683516436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:19.485016054 +0000 UTC m=+22.600630252" watchObservedRunningTime="2026-06-14 03:13:19.485957788 +0000 UTC m=+22.601571987" Jun 14 03:13:19.542697 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.542651 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qrjdh" podStartSLOduration=3.515898099 podStartE2EDuration="22.542634587s" totalImagesPullingTime="19.026736488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:19.52434253 +0000 UTC m=+22.639956752" watchObservedRunningTime="2026-06-14 03:13:19.542634587 +0000 UTC m=+22.658248838" Jun 14 03:13:19.607853 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.607794 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:19.680182 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.680149 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:19.739435 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:19.739348 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:20.334378 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:20.334344 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:20.334620 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:20.334586 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:20.451613 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:20.451591 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:13:20.452006 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:20.451983 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" event={"ID":"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba","Type":"ContainerStarted","Data":"f38265e84018a40ffb1b504521579c417dab02ee3c553726fc8eb9f5c0275118"} Jun 14 03:13:20.452128 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:20.452065 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" event={"ID":"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba","Type":"ContainerStarted","Data":"6f10699ca2b9c03c34676c6848ac58b918334b700460700f5d191fe0c062aa1c"} Jun 14 03:13:20.452128 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:20.452118 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" event={"ID":"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba","Type":"ContainerStarted","Data":"ead14b0f52350ad64c0d2ec23e7b4c2fedb2f232aaa525f69d99d9d08b8f85a2"} Jun 14 03:13:20.452239 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:20.452169 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" event={"ID":"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba","Type":"ContainerStarted","Data":"7386797d6c56e91295a84f1e98198ba886d5c4bffd4fbdef697b24648903018e"} Jun 14 03:13:20.671542 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:20.671514 2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 03:13:21.334577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.334544 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:21.335080 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:21.334663 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:21.335080 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.334544 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:21.335080 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:21.334962 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:21.336505 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.336413 2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T03:13:20.671537025Z","UUID":"f927e6d2-f941-4eab-8719-2a9b0375aaa8","Handler":null,"Name":"","Endpoint":""} Jun 14 03:13:21.338540 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.338522 2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 03:13:21.338637 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.338555 2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 03:13:21.460981 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.460939 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" event={"ID":"25581579-bf17-446e-933e-a94c0f64f0f3","Type":"ContainerStarted","Data":"b21901e36b3edb53bcdd3f64a453c84e9274c97c0e0e22b02c697a0f11e26a36"} Jun 14 03:13:21.462651 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.462625 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w87dh" event={"ID":"b8578348-6f58-4a49-a01a-095586531729","Type":"ContainerStarted","Data":"6dc495be19b767c709f02f14060d2036f1659fed967f7fc25a851ce017c9467f"} Jun 14 03:13:21.478037 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.477998 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-slkjx" podStartSLOduration=5.464522415 podStartE2EDuration="24.477984151s" totalImagesPullingTime="19.013461736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:19.542394355 +0000 UTC m=+22.658008549" watchObservedRunningTime="2026-06-14 03:13:21.477984151 +0000 UTC m=+24.593598350" Jun 14 03:13:21.478319 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.478293 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w87dh" podStartSLOduration=5.458375071 podStartE2EDuration="24.478283868s" totalImagesPullingTime="19.019908797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:21.477961634 +0000 UTC m=+24.593575833" watchObservedRunningTime="2026-06-14 03:13:21.478283868 +0000 UTC m=+24.593898066" Jun 14 03:13:21.595945 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.595849 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:21.648941 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.648905 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:21.923938 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.923910 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:13:21.924669 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:21.924649 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:13:22.334332 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:22.334264 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:22.334525 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:22.334365 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:22.466860 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:22.466821 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" event={"ID":"25581579-bf17-446e-933e-a94c0f64f0f3","Type":"ContainerStarted","Data":"d5310f56bae88037b33681023ebb014ccc25533fcf20fa8b11084ede59edba3a"} Jun 14 03:13:22.469736 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:22.469710 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:13:22.470112 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:22.470089 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" event={"ID":"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba","Type":"ContainerStarted","Data":"1951c5cd25e7931e52580a830eb22e550436c0d22e674ba8f88daf34303b5b87"} Jun 14 03:13:22.470321 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:22.470307 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:13:22.470760 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:22.470739 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2x29m" Jun 14 03:13:22.484065 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:22.484019 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h4v8q" podStartSLOduration=3.982513356 podStartE2EDuration="25.484003302s" totalImagesPullingTime="21.501489946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:22.483765349 +0000 UTC m=+25.599379550" watchObservedRunningTime="2026-06-14 03:13:22.484003302 +0000 UTC m=+25.599617501" Jun 14 03:13:22.542544 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:22.542461 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:22.642678 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:22.642449 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:22.694260 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:22.694223 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:23.334500 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:23.334467 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:23.334755 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:23.334592 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:23.334755 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:23.334651 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:23.334895 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:23.334784 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:24.334614 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:24.334586 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:24.335363 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:24.334718 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:24.477386 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:24.477149 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:13:24.477742 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:24.477716 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" event={"ID":"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba","Type":"ContainerStarted","Data":"982421213bdc6fb2ed555268eba3dc5758a5f8a5b6617ba327206aef4481e99b"} Jun 14 03:13:24.478029 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:24.478009 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:13:24.478268 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:24.478249 2547 scope.go:117] "RemoveContainer" containerID="93aadc3493d5a70a8397e3270aa05962b37a78cfd0a71f965c6667bad4ec6250" Jun 14 03:13:24.479706 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:24.479680 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skzpc" event={"ID":"afa64b2b-aefd-45ef-83c2-d6b12442466f","Type":"ContainerStarted","Data":"62e513cc6f1458acc74c409a8e570a1eb4325f28c65d75a6dfb2349a8be00f5e"} Jun 14 03:13:24.498387 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:24.498356 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:13:25.334073 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:25.334033 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:25.334262 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:25.334168 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:25.334262 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:25.334214 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:25.334346 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:25.334299 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:25.486432 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:25.486405 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:13:25.487312 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:25.487285 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" event={"ID":"9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba","Type":"ContainerStarted","Data":"f989684d5e3931cf1b5ca95b83c0f18e850598e0e9a6ad9ace7d7a4977edec19"} Jun 14 03:13:25.488739 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:25.488687 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:13:25.488958 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:25.488946 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:13:25.491335 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:25.491309 2547 generic.go:356] "Generic (PLEG): container finished" podID="afa64b2b-aefd-45ef-83c2-d6b12442466f" containerID="62e513cc6f1458acc74c409a8e570a1eb4325f28c65d75a6dfb2349a8be00f5e" exitCode=0 Jun 14 03:13:25.491448 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:25.491355 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skzpc" event={"ID":"afa64b2b-aefd-45ef-83c2-d6b12442466f","Type":"ContainerDied","Data":"62e513cc6f1458acc74c409a8e570a1eb4325f28c65d75a6dfb2349a8be00f5e"} Jun 14 03:13:25.508344 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:25.508319 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:13:25.514499 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:25.514444 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" podStartSLOduration=9.379774413 podStartE2EDuration="28.514428823s" totalImagesPullingTime="19.13465441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:25.512981701 +0000 UTC m=+28.628595904" watchObservedRunningTime="2026-06-14 03:13:25.514428823 +0000 UTC m=+28.630043022" Jun 14 03:13:26.189704 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:26.189669 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tb2nl"] Jun 14 03:13:26.189925 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:26.189854 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:26.189972 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:26.189941 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:26.194350 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:26.194319 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x2pv9"] Jun 14 03:13:26.194475 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:26.194440 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:26.194557 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:26.194532 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:26.195015 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:26.194995 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d6lrk"] Jun 14 03:13:26.195116 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:26.195102 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:26.195228 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:26.195209 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:27.497998 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:27.497791 2547 generic.go:356] "Generic (PLEG): container finished" podID="afa64b2b-aefd-45ef-83c2-d6b12442466f" containerID="66156bfaf4476d2ef927be86a040835dbd78e29cac1f11f2cb26c903c68fd522" exitCode=0 Jun 14 03:13:27.498393 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:27.497878 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skzpc" event={"ID":"afa64b2b-aefd-45ef-83c2-d6b12442466f","Type":"ContainerDied","Data":"66156bfaf4476d2ef927be86a040835dbd78e29cac1f11f2cb26c903c68fd522"} Jun 14 03:13:28.334613 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:28.334576 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:28.334753 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:28.334614 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:28.334753 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:28.334675 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:28.334753 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:28.334688 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:28.334874 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:28.334753 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:28.334874 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:28.334831 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:29.504347 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:29.504315 2547 generic.go:356] "Generic (PLEG): container finished" podID="afa64b2b-aefd-45ef-83c2-d6b12442466f" containerID="ebaf467b54f7a2ee5a8fa917292cb15794e8bd82d82f05a736c4d9fc8ec34881" exitCode=0 Jun 14 03:13:29.504992 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:29.504363 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skzpc" event={"ID":"afa64b2b-aefd-45ef-83c2-d6b12442466f","Type":"ContainerDied","Data":"ebaf467b54f7a2ee5a8fa917292cb15794e8bd82d82f05a736c4d9fc8ec34881"} Jun 14 03:13:30.334664 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:30.334629 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:30.334843 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:30.334671 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:30.334843 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:30.334769 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb2nl" podUID="4ce4318a-11be-4ff3-80e4-81110e91667b" Jun 14 03:13:30.334957 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:30.334938 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:30.335074 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:30.335046 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x2pv9" podUID="75593b11-91aa-4a6a-843b-cfb6d38be68d" Jun 14 03:13:30.335170 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:30.335150 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:13:31.037689 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:31.037654 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:31.038305 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:31.037813 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:31.038305 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:31.037884 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs podName:ece5ab3c-1b05-4071-a849-e437253af84f nodeName:}" failed. No retries permitted until 2026-06-14 03:14:03.037862941 +0000 UTC m=+66.153477135 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs") pod "network-metrics-daemon-d6lrk" (UID: "ece5ab3c-1b05-4071-a849-e437253af84f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 03:13:31.138539 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:31.138503 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4fl\" (UniqueName: \"kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl\") pod \"network-check-target-tb2nl\" (UID: \"4ce4318a-11be-4ff3-80e4-81110e91667b\") " pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:31.138539 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:31.138545 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:31.138779 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:31.138637 2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:31.138779 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:31.138669 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 03:13:31.138779 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:31.138689 2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 03:13:31.138779 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:31.138699 2547 projected.go:196] Error preparing data for projected volume kube-api-access-fs4fl for pod openshift-network-diagnostics/network-check-target-tb2nl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:31.138779 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:31.138702 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret podName:75593b11-91aa-4a6a-843b-cfb6d38be68d nodeName:}" failed. No retries permitted until 2026-06-14 03:14:03.138684313 +0000 UTC m=+66.254298492 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret") pod "global-pull-secret-syncer-x2pv9" (UID: "75593b11-91aa-4a6a-843b-cfb6d38be68d") : object "kube-system"/"original-pull-secret" not registered Jun 14 03:13:31.138779 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:31.138745 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl podName:4ce4318a-11be-4ff3-80e4-81110e91667b nodeName:}" failed. No retries permitted until 2026-06-14 03:14:03.138731515 +0000 UTC m=+66.254345696 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fs4fl" (UniqueName: "kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl") pod "network-check-target-tb2nl" (UID: "4ce4318a-11be-4ff3-80e4-81110e91667b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 03:13:32.143178 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.143148 2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-82.ec2.internal" event="NodeReady" Jun 14 03:13:32.143775 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.143318 2547 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 03:13:32.185616 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.185551 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pcxsf"] Jun 14 03:13:32.187972 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.187884 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.188546 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.188525 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qt8pz"] Jun 14 03:13:32.190231 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.190210 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qt8pz" Jun 14 03:13:32.190339 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.190309 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 03:13:32.190339 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.190325 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctq98\"" Jun 14 03:13:32.190459 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.190310 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 03:13:32.192437 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.192413 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 03:13:32.192966 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.192942 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pf4ph\"" Jun 14 03:13:32.193053 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.192943 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 03:13:32.193272 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.193259 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 03:13:32.198311 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.197727 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pcxsf"] Jun 14 03:13:32.200317 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.200240 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qt8pz"] Jun 14 03:13:32.305715 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.305677 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:32.334316 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.334283 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:13:32.334316 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.334314 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:13:32.334564 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.334315 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:13:32.337076 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.337004 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 03:13:32.337076 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.337031 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 03:13:32.337240 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.337127 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68bfl\"" Jun 14 03:13:32.337299 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.337275 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hmrz\"" Jun 14 03:13:32.337354 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.337327 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 03:13:32.337532 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.337353 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 03:13:32.347295 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.347212 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.347295 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.347256 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34053198-82d1-4bd6-ac10-c8ba3216c9bb-tmp-dir\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.347450 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.347373 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34053198-82d1-4bd6-ac10-c8ba3216c9bb-config-volume\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.347450 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.347411 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh2zh\" (UniqueName: \"kubernetes.io/projected/c0f6c0a1-34ad-4271-853b-fb196399dd18-kube-api-access-qh2zh\") pod \"ingress-canary-qt8pz\" (UID: \"c0f6c0a1-34ad-4271-853b-fb196399dd18\") " pod="openshift-ingress-canary/ingress-canary-qt8pz" Jun 14 03:13:32.347450 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.347447 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lcwd\" (UniqueName: \"kubernetes.io/projected/34053198-82d1-4bd6-ac10-c8ba3216c9bb-kube-api-access-4lcwd\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.347594 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.347484 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0f6c0a1-34ad-4271-853b-fb196399dd18-cert\") pod \"ingress-canary-qt8pz\" (UID: \"c0f6c0a1-34ad-4271-853b-fb196399dd18\") " pod="openshift-ingress-canary/ingress-canary-qt8pz" Jun 14 03:13:32.405736 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.405677 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:32.448644 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.448611 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.448644 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.448648 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34053198-82d1-4bd6-ac10-c8ba3216c9bb-tmp-dir\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.448887 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.448691 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34053198-82d1-4bd6-ac10-c8ba3216c9bb-config-volume\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.448887 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:32.448787 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:32.448887 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.448829 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh2zh\" (UniqueName: \"kubernetes.io/projected/c0f6c0a1-34ad-4271-853b-fb196399dd18-kube-api-access-qh2zh\") pod \"ingress-canary-qt8pz\" (UID: \"c0f6c0a1-34ad-4271-853b-fb196399dd18\") " pod="openshift-ingress-canary/ingress-canary-qt8pz" Jun 14 03:13:32.448887 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:32.448873 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls podName:34053198-82d1-4bd6-ac10-c8ba3216c9bb nodeName:}" failed. No retries permitted until 2026-06-14 03:13:32.948851023 +0000 UTC m=+36.064465204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls") pod "dns-default-pcxsf" (UID: "34053198-82d1-4bd6-ac10-c8ba3216c9bb") : secret "dns-default-metrics-tls" not found Jun 14 03:13:32.449147 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.448911 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lcwd\" (UniqueName: \"kubernetes.io/projected/34053198-82d1-4bd6-ac10-c8ba3216c9bb-kube-api-access-4lcwd\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.449147 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.448941 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0f6c0a1-34ad-4271-853b-fb196399dd18-cert\") pod \"ingress-canary-qt8pz\" (UID: \"c0f6c0a1-34ad-4271-853b-fb196399dd18\") " pod="openshift-ingress-canary/ingress-canary-qt8pz" Jun 14 03:13:32.449147 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.449058 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34053198-82d1-4bd6-ac10-c8ba3216c9bb-tmp-dir\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.449414 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.449391 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/34053198-82d1-4bd6-ac10-c8ba3216c9bb-config-volume\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.453777 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.453750 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c0f6c0a1-34ad-4271-853b-fb196399dd18-cert\") pod \"ingress-canary-qt8pz\" (UID: \"c0f6c0a1-34ad-4271-853b-fb196399dd18\") " pod="openshift-ingress-canary/ingress-canary-qt8pz" Jun 14 03:13:32.460161 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.460136 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lcwd\" (UniqueName: \"kubernetes.io/projected/34053198-82d1-4bd6-ac10-c8ba3216c9bb-kube-api-access-4lcwd\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.460379 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.460359 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh2zh\" (UniqueName: \"kubernetes.io/projected/c0f6c0a1-34ad-4271-853b-fb196399dd18-kube-api-access-qh2zh\") pod \"ingress-canary-qt8pz\" (UID: \"c0f6c0a1-34ad-4271-853b-fb196399dd18\") " pod="openshift-ingress-canary/ingress-canary-qt8pz" Jun 14 03:13:32.475043 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.475001 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:32.507899 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.507866 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qt8pz" Jun 14 03:13:32.529724 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.529692 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:32.630153 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.630120 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:32.731271 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.731181 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:32.952032 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:32.951985 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:32.952215 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:32.952124 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:32.952215 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:32.952186 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls podName:34053198-82d1-4bd6-ac10-c8ba3216c9bb nodeName:}" failed. No retries permitted until 2026-06-14 03:13:33.952171053 +0000 UTC m=+37.067785231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls") pod "dns-default-pcxsf" (UID: "34053198-82d1-4bd6-ac10-c8ba3216c9bb") : secret "dns-default-metrics-tls" not found Jun 14 03:13:33.550746 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:33.550706 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:33.602228 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:33.602187 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:33.959503 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:33.959338 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:33.959636 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:33.959606 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:33.959703 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:33.959695 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls podName:34053198-82d1-4bd6-ac10-c8ba3216c9bb nodeName:}" failed. No retries permitted until 2026-06-14 03:13:35.95967032 +0000 UTC m=+39.075284498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls") pod "dns-default-pcxsf" (UID: "34053198-82d1-4bd6-ac10-c8ba3216c9bb") : secret "dns-default-metrics-tls" not found Jun 14 03:13:33.991134 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:33.991103 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qt8pz"] Jun 14 03:13:33.994379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:13:33.994338 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f6c0a1_34ad_4271_853b_fb196399dd18.slice/crio-3c797ff2f3460a0a737c3399e6ff5d0e03c1ce06cf25337ea24659d7117b8d55 WatchSource:0}: Error finding container 3c797ff2f3460a0a737c3399e6ff5d0e03c1ce06cf25337ea24659d7117b8d55: Status 404 returned error can't find the container with id 3c797ff2f3460a0a737c3399e6ff5d0e03c1ce06cf25337ea24659d7117b8d55 Jun 14 03:13:34.519093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:34.519062 2547 generic.go:356] "Generic (PLEG): container finished" podID="afa64b2b-aefd-45ef-83c2-d6b12442466f" containerID="e90fbe4345348c1c7cc41fd8a726e8a2b9c856cdf81463af5dc9072eaa8e45a2" exitCode=0 Jun 14 03:13:34.519278 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:34.519111 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skzpc" event={"ID":"afa64b2b-aefd-45ef-83c2-d6b12442466f","Type":"ContainerDied","Data":"e90fbe4345348c1c7cc41fd8a726e8a2b9c856cdf81463af5dc9072eaa8e45a2"} Jun 14 03:13:34.520418 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:34.520396 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qt8pz" event={"ID":"c0f6c0a1-34ad-4271-853b-fb196399dd18","Type":"ContainerStarted","Data":"3c797ff2f3460a0a737c3399e6ff5d0e03c1ce06cf25337ea24659d7117b8d55"} Jun 14 03:13:35.526478 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:35.526444 2547 generic.go:356] "Generic (PLEG): container finished" podID="afa64b2b-aefd-45ef-83c2-d6b12442466f" containerID="ee4e92810134d3c1d5550dd3815afffd70234051159614528d632578fddd2c41" exitCode=0 Jun 14 03:13:35.527060 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:35.526512 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skzpc" event={"ID":"afa64b2b-aefd-45ef-83c2-d6b12442466f","Type":"ContainerDied","Data":"ee4e92810134d3c1d5550dd3815afffd70234051159614528d632578fddd2c41"} Jun 14 03:13:35.974561 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:35.974381 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:35.974715 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:35.974526 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:35.974715 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:35.974624 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls podName:34053198-82d1-4bd6-ac10-c8ba3216c9bb nodeName:}" failed. No retries permitted until 2026-06-14 03:13:39.974608141 +0000 UTC m=+43.090222318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls") pod "dns-default-pcxsf" (UID: "34053198-82d1-4bd6-ac10-c8ba3216c9bb") : secret "dns-default-metrics-tls" not found Jun 14 03:13:36.498371 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:36.498332 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:36.532713 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:36.532626 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skzpc" event={"ID":"afa64b2b-aefd-45ef-83c2-d6b12442466f","Type":"ContainerStarted","Data":"bfff61a4c1c415a41de5e74b791d89c917ca507b90bf989f680965c5f4264da4"} Jun 14 03:13:36.534171 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:36.534151 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qt8pz" event={"ID":"c0f6c0a1-34ad-4271-853b-fb196399dd18","Type":"ContainerStarted","Data":"3403a78f06be7e05aa2406fb5aad96d8d75db07e5371b786d044d8a259b02ab6"} Jun 14 03:13:36.556873 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:36.556817 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-skzpc" podStartSLOduration=9.069645716 podStartE2EDuration="39.556780661s" totalImagesPullingTime="30.487134945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:36.55621388 +0000 UTC m=+39.671828090" watchObservedRunningTime="2026-06-14 03:13:36.556780661 +0000 UTC m=+39.672394861" Jun 14 03:13:36.571256 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:36.571211 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qt8pz" podStartSLOduration=2.288895364 podStartE2EDuration="4.571193811s" totalImagesPullingTime="2.282298447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:13:36.570711505 +0000 UTC m=+39.686325704" watchObservedRunningTime="2026-06-14 03:13:36.571193811 +0000 UTC m=+39.686808007" Jun 14 03:13:36.700310 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:36.700279 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:36.752958 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:36.752931 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:36.849357 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:36.849267 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:36.952860 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:36.952819 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:38.059410 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:38.059372 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:38.114822 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:38.114775 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:40.006586 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:40.006548 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:40.006984 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:40.006697 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:40.006984 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:40.006760 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls podName:34053198-82d1-4bd6-ac10-c8ba3216c9bb nodeName:}" failed. No retries permitted until 2026-06-14 03:13:48.006744281 +0000 UTC m=+51.122358463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls") pod "dns-default-pcxsf" (UID: "34053198-82d1-4bd6-ac10-c8ba3216c9bb") : secret "dns-default-metrics-tls" not found Jun 14 03:13:44.813261 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:44.813222 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:44.869792 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:44.869766 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:47.633398 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:47.633344 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:47.734546 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:47.734511 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:48.066495 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:48.066452 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:13:48.066669 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:48.066597 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:13:48.066669 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:13:48.066658 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls podName:34053198-82d1-4bd6-ac10-c8ba3216c9bb nodeName:}" failed. No retries permitted until 2026-06-14 03:14:04.066640673 +0000 UTC m=+67.182254867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls") pod "dns-default-pcxsf" (UID: "34053198-82d1-4bd6-ac10-c8ba3216c9bb") : secret "dns-default-metrics-tls" not found Jun 14 03:13:57.519774 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:57.519747 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zbx79" Jun 14 03:13:57.671152 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:57.671114 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:13:57.728144 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:13:57.728106 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:14:00.616118 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.616086 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j"] Jun 14 03:14:00.618580 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.618558 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" Jun 14 03:14:00.621963 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.621935 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qgrnn\"" Jun 14 03:14:00.622065 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.621936 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 14 03:14:00.622065 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.621936 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 14 03:14:00.622065 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.621937 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 14 03:14:00.622065 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.622010 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 14 03:14:00.628342 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.628323 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j"] Jun 14 03:14:00.645307 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.645283 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v"] Jun 14 03:14:00.646956 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.646943 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:00.649108 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.649089 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 14 03:14:00.655554 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.655531 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v"] Jun 14 03:14:00.659091 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.659069 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/089d8b07-adbe-4494-99d6-3d4b12d890e1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57668dfc54-j2k8j\" (UID: \"089d8b07-adbe-4494-99d6-3d4b12d890e1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" Jun 14 03:14:00.659188 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.659133 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvsnk\" (UniqueName: \"kubernetes.io/projected/089d8b07-adbe-4494-99d6-3d4b12d890e1-kube-api-access-rvsnk\") pod \"managed-serviceaccount-addon-agent-57668dfc54-j2k8j\" (UID: \"089d8b07-adbe-4494-99d6-3d4b12d890e1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" Jun 14 03:14:00.759880 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.759836 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91deec1-3cce-48cb-ad56-54c5d4b60038-tmp\") pod \"klusterlet-addon-workmgr-6c886887c-vgz2v\" (UID: \"f91deec1-3cce-48cb-ad56-54c5d4b60038\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:00.760045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.759910 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8g24\" (UniqueName: \"kubernetes.io/projected/f91deec1-3cce-48cb-ad56-54c5d4b60038-kube-api-access-q8g24\") pod \"klusterlet-addon-workmgr-6c886887c-vgz2v\" (UID: \"f91deec1-3cce-48cb-ad56-54c5d4b60038\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:00.760045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.759934 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvsnk\" (UniqueName: \"kubernetes.io/projected/089d8b07-adbe-4494-99d6-3d4b12d890e1-kube-api-access-rvsnk\") pod \"managed-serviceaccount-addon-agent-57668dfc54-j2k8j\" (UID: \"089d8b07-adbe-4494-99d6-3d4b12d890e1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" Jun 14 03:14:00.760045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.759951 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f91deec1-3cce-48cb-ad56-54c5d4b60038-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c886887c-vgz2v\" (UID: \"f91deec1-3cce-48cb-ad56-54c5d4b60038\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:00.760045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.760020 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/089d8b07-adbe-4494-99d6-3d4b12d890e1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57668dfc54-j2k8j\" (UID: \"089d8b07-adbe-4494-99d6-3d4b12d890e1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" Jun 14 03:14:00.764584 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.764560 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/089d8b07-adbe-4494-99d6-3d4b12d890e1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57668dfc54-j2k8j\" (UID: \"089d8b07-adbe-4494-99d6-3d4b12d890e1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" Jun 14 03:14:00.767584 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.767554 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvsnk\" (UniqueName: \"kubernetes.io/projected/089d8b07-adbe-4494-99d6-3d4b12d890e1-kube-api-access-rvsnk\") pod \"managed-serviceaccount-addon-agent-57668dfc54-j2k8j\" (UID: \"089d8b07-adbe-4494-99d6-3d4b12d890e1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" Jun 14 03:14:00.861043 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.861003 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91deec1-3cce-48cb-ad56-54c5d4b60038-tmp\") pod \"klusterlet-addon-workmgr-6c886887c-vgz2v\" (UID: \"f91deec1-3cce-48cb-ad56-54c5d4b60038\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:00.861043 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.861050 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8g24\" (UniqueName: \"kubernetes.io/projected/f91deec1-3cce-48cb-ad56-54c5d4b60038-kube-api-access-q8g24\") pod \"klusterlet-addon-workmgr-6c886887c-vgz2v\" (UID: \"f91deec1-3cce-48cb-ad56-54c5d4b60038\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:00.861248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.861072 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f91deec1-3cce-48cb-ad56-54c5d4b60038-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c886887c-vgz2v\" (UID: \"f91deec1-3cce-48cb-ad56-54c5d4b60038\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:00.861481 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.861461 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91deec1-3cce-48cb-ad56-54c5d4b60038-tmp\") pod \"klusterlet-addon-workmgr-6c886887c-vgz2v\" (UID: \"f91deec1-3cce-48cb-ad56-54c5d4b60038\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:00.863482 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.863466 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f91deec1-3cce-48cb-ad56-54c5d4b60038-klusterlet-config\") pod \"klusterlet-addon-workmgr-6c886887c-vgz2v\" (UID: \"f91deec1-3cce-48cb-ad56-54c5d4b60038\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:00.868869 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.868818 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8g24\" (UniqueName: \"kubernetes.io/projected/f91deec1-3cce-48cb-ad56-54c5d4b60038-kube-api-access-q8g24\") pod \"klusterlet-addon-workmgr-6c886887c-vgz2v\" (UID: \"f91deec1-3cce-48cb-ad56-54c5d4b60038\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:00.937180 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.937131 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" Jun 14 03:14:00.955494 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:00.955459 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:01.063367 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:01.063325 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j"] Jun 14 03:14:01.066923 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:14:01.066893 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod089d8b07_adbe_4494_99d6_3d4b12d890e1.slice/crio-6c14c6992f8af1ae6c678f3a9b4aa3103171714bb6324819a25916e688da1fd9 WatchSource:0}: Error finding container 6c14c6992f8af1ae6c678f3a9b4aa3103171714bb6324819a25916e688da1fd9: Status 404 returned error can't find the container with id 6c14c6992f8af1ae6c678f3a9b4aa3103171714bb6324819a25916e688da1fd9 Jun 14 03:14:01.079019 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:01.078996 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v"] Jun 14 03:14:01.082065 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:14:01.082041 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91deec1_3cce_48cb_ad56_54c5d4b60038.slice/crio-8bbdf41e2b11274a50e6b90fc860238ed64875c5d3d22dbbe4a8ab902b2b4cab WatchSource:0}: Error finding container 8bbdf41e2b11274a50e6b90fc860238ed64875c5d3d22dbbe4a8ab902b2b4cab: Status 404 returned error can't find the container with id 8bbdf41e2b11274a50e6b90fc860238ed64875c5d3d22dbbe4a8ab902b2b4cab Jun 14 03:14:01.593792 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:01.593751 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" event={"ID":"f91deec1-3cce-48cb-ad56-54c5d4b60038","Type":"ContainerStarted","Data":"8bbdf41e2b11274a50e6b90fc860238ed64875c5d3d22dbbe4a8ab902b2b4cab"} Jun 14 03:14:01.594716 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:01.594694 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" event={"ID":"089d8b07-adbe-4494-99d6-3d4b12d890e1","Type":"ContainerStarted","Data":"6c14c6992f8af1ae6c678f3a9b4aa3103171714bb6324819a25916e688da1fd9"} Jun 14 03:14:03.079323 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.079285 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:14:03.082250 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.082222 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 03:14:03.090419 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:14:03.090392 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 03:14:03.090552 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:14:03.090471 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs podName:ece5ab3c-1b05-4071-a849-e437253af84f nodeName:}" failed. No retries permitted until 2026-06-14 03:15:07.090447257 +0000 UTC m=+130.206061436 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs") pod "network-metrics-daemon-d6lrk" (UID: "ece5ab3c-1b05-4071-a849-e437253af84f") : secret "metrics-daemon-secret" not found Jun 14 03:14:03.180105 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.180070 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4fl\" (UniqueName: \"kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl\") pod \"network-check-target-tb2nl\" (UID: \"4ce4318a-11be-4ff3-80e4-81110e91667b\") " pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:14:03.180276 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.180119 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:14:03.182899 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.182876 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 03:14:03.183028 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.182911 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 03:14:03.193089 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.193065 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 03:14:03.193207 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.193191 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75593b11-91aa-4a6a-843b-cfb6d38be68d-original-pull-secret\") pod \"global-pull-secret-syncer-x2pv9\" (UID: \"75593b11-91aa-4a6a-843b-cfb6d38be68d\") " pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:14:03.203851 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.203823 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4fl\" (UniqueName: \"kubernetes.io/projected/4ce4318a-11be-4ff3-80e4-81110e91667b-kube-api-access-fs4fl\") pod \"network-check-target-tb2nl\" (UID: \"4ce4318a-11be-4ff3-80e4-81110e91667b\") " pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:14:03.259280 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.259251 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68bfl\"" Jun 14 03:14:03.262090 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.262065 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x2pv9" Jun 14 03:14:03.267282 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:03.267266 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:14:04.086008 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:04.085959 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:14:04.086538 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:14:04.086163 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:14:04.086538 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:14:04.086235 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls podName:34053198-82d1-4bd6-ac10-c8ba3216c9bb nodeName:}" failed. No retries permitted until 2026-06-14 03:14:36.086214615 +0000 UTC m=+99.201828794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls") pod "dns-default-pcxsf" (UID: "34053198-82d1-4bd6-ac10-c8ba3216c9bb") : secret "dns-default-metrics-tls" not found Jun 14 03:14:05.312348 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:05.312312 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:14:05.362853 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:05.362817 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:14:06.192607 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:06.192555 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x2pv9"] Jun 14 03:14:06.210233 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:06.210206 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tb2nl"] Jun 14 03:14:06.363940 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:14:06.363864 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75593b11_91aa_4a6a_843b_cfb6d38be68d.slice/crio-2b335e76d846adfb374098f6c5bcebd23f12992ce3226ea1a1554238e3e24894 WatchSource:0}: Error finding container 2b335e76d846adfb374098f6c5bcebd23f12992ce3226ea1a1554238e3e24894: Status 404 returned error can't find the container with id 2b335e76d846adfb374098f6c5bcebd23f12992ce3226ea1a1554238e3e24894 Jun 14 03:14:06.364485 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:14:06.364457 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce4318a_11be_4ff3_80e4_81110e91667b.slice/crio-54a27fe9a19ba0122fca696addaa9946d467da5e41abb5d192ee38956ced2990 WatchSource:0}: Error finding container 54a27fe9a19ba0122fca696addaa9946d467da5e41abb5d192ee38956ced2990: Status 404 returned error can't find the container with id 54a27fe9a19ba0122fca696addaa9946d467da5e41abb5d192ee38956ced2990 Jun 14 03:14:06.609188 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:06.609154 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" event={"ID":"089d8b07-adbe-4494-99d6-3d4b12d890e1","Type":"ContainerStarted","Data":"106f1bf8256ec9b1795c9eca0f792fd1e00c5586fa8178f087361a0f8b6b1eb9"} Jun 14 03:14:06.610527 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:06.610501 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" event={"ID":"f91deec1-3cce-48cb-ad56-54c5d4b60038","Type":"ContainerStarted","Data":"bc0e0df0d568556b62e8438b6ff27e393bde003e83889b4e887bf61728257849"} Jun 14 03:14:06.610688 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:06.610646 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:06.611669 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:06.611650 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tb2nl" event={"ID":"4ce4318a-11be-4ff3-80e4-81110e91667b","Type":"ContainerStarted","Data":"54a27fe9a19ba0122fca696addaa9946d467da5e41abb5d192ee38956ced2990"} Jun 14 03:14:06.612899 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:06.612865 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:14:06.613361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:06.613335 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x2pv9" event={"ID":"75593b11-91aa-4a6a-843b-cfb6d38be68d","Type":"ContainerStarted","Data":"2b335e76d846adfb374098f6c5bcebd23f12992ce3226ea1a1554238e3e24894"} Jun 14 03:14:06.624958 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:06.624867 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" podStartSLOduration=1.624117502 podStartE2EDuration="6.624850991s" totalImagesPullingTime="5.000733489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:14:06.62450933 +0000 UTC m=+69.740123552" watchObservedRunningTime="2026-06-14 03:14:06.624850991 +0000 UTC m=+69.740465192" Jun 14 03:14:06.640817 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:06.640748 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" podStartSLOduration=1.327916326 podStartE2EDuration="6.640733773s" totalImagesPullingTime="5.312817447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:14:06.640337907 +0000 UTC m=+69.755952109" watchObservedRunningTime="2026-06-14 03:14:06.640733773 +0000 UTC m=+69.756347972" Jun 14 03:14:09.581166 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:09.581130 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:14:09.634306 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:09.634273 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:14:11.628060 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:11.628015 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x2pv9" event={"ID":"75593b11-91aa-4a6a-843b-cfb6d38be68d","Type":"ContainerStarted","Data":"95ad2f0a91198f10102c62dae3d1424d2fd2af9d3708d7f29129d1e65a2d6181"} Jun 14 03:14:11.629439 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:11.629411 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tb2nl" event={"ID":"4ce4318a-11be-4ff3-80e4-81110e91667b","Type":"ContainerStarted","Data":"eb2b976ecdceb1159abc91e5e4712fb140cf285d69b4b0b18f035e6bdeda9e11"} Jun 14 03:14:11.629571 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:11.629553 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:14:11.642261 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:11.642211 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x2pv9" podStartSLOduration=70.025803206 podStartE2EDuration="1m14.642194873s" totalImagesPullingTime="4.616391667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:14:11.641571461 +0000 UTC m=+74.757185660" watchObservedRunningTime="2026-06-14 03:14:11.642194873 +0000 UTC m=+74.757809071" Jun 14 03:14:11.655991 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:11.655932 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tb2nl" podStartSLOduration=70.044247282 podStartE2EDuration="1m14.655914685s" totalImagesPullingTime="4.611667403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:14:11.655195388 +0000 UTC m=+74.770809587" watchObservedRunningTime="2026-06-14 03:14:11.655914685 +0000 UTC m=+74.771528883" Jun 14 03:14:36.113466 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:36.113373 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:14:36.113918 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:14:36.113500 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:14:36.113918 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:14:36.113552 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls podName:34053198-82d1-4bd6-ac10-c8ba3216c9bb nodeName:}" failed. No retries permitted until 2026-06-14 03:15:40.113539334 +0000 UTC m=+163.229153511 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls") pod "dns-default-pcxsf" (UID: "34053198-82d1-4bd6-ac10-c8ba3216c9bb") : secret "dns-default-metrics-tls" not found Jun 14 03:14:42.634940 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:14:42.634905 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tb2nl" Jun 14 03:15:07.125316 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:15:07.125272 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:15:07.125862 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:15:07.125400 2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 03:15:07.125862 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:15:07.125470 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs podName:ece5ab3c-1b05-4071-a849-e437253af84f nodeName:}" failed. No retries permitted until 2026-06-14 03:17:09.125455544 +0000 UTC m=+252.241069720 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs") pod "network-metrics-daemon-d6lrk" (UID: "ece5ab3c-1b05-4071-a849-e437253af84f") : secret "metrics-daemon-secret" not found Jun 14 03:15:35.202399 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:15:35.202352 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pcxsf" podUID="34053198-82d1-4bd6-ac10-c8ba3216c9bb" Jun 14 03:15:35.346161 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:15:35.346119 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-d6lrk" podUID="ece5ab3c-1b05-4071-a849-e437253af84f" Jun 14 03:15:35.869280 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:15:35.869249 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcxsf" Jun 14 03:15:40.147318 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:15:40.147275 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:15:40.147834 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:15:40.147413 2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 03:15:40.147834 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:15:40.147503 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls podName:34053198-82d1-4bd6-ac10-c8ba3216c9bb nodeName:}" failed. No retries permitted until 2026-06-14 03:17:42.147482577 +0000 UTC m=+285.263096765 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls") pod "dns-default-pcxsf" (UID: "34053198-82d1-4bd6-ac10-c8ba3216c9bb") : secret "dns-default-metrics-tls" not found Jun 14 03:15:49.335006 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:15:49.334920 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:16:06.611573 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:06.611527 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" podUID="f91deec1-3cce-48cb-ad56-54c5d4b60038" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" Jun 14 03:16:06.953030 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:06.953000 2547 generic.go:356] "Generic (PLEG): container finished" podID="f91deec1-3cce-48cb-ad56-54c5d4b60038" containerID="bc0e0df0d568556b62e8438b6ff27e393bde003e83889b4e887bf61728257849" exitCode=1 Jun 14 03:16:06.953184 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:06.953076 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" event={"ID":"f91deec1-3cce-48cb-ad56-54c5d4b60038","Type":"ContainerDied","Data":"bc0e0df0d568556b62e8438b6ff27e393bde003e83889b4e887bf61728257849"} Jun 14 03:16:06.953429 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:06.953414 2547 scope.go:117] "RemoveContainer" containerID="bc0e0df0d568556b62e8438b6ff27e393bde003e83889b4e887bf61728257849" Jun 14 03:16:06.954505 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:06.954486 2547 generic.go:356] "Generic (PLEG): container finished" podID="089d8b07-adbe-4494-99d6-3d4b12d890e1" containerID="106f1bf8256ec9b1795c9eca0f792fd1e00c5586fa8178f087361a0f8b6b1eb9" exitCode=255 Jun 14 03:16:06.954609 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:06.954544 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" event={"ID":"089d8b07-adbe-4494-99d6-3d4b12d890e1","Type":"ContainerDied","Data":"106f1bf8256ec9b1795c9eca0f792fd1e00c5586fa8178f087361a0f8b6b1eb9"} Jun 14 03:16:06.960692 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:06.960675 2547 scope.go:117] "RemoveContainer" containerID="106f1bf8256ec9b1795c9eca0f792fd1e00c5586fa8178f087361a0f8b6b1eb9" Jun 14 03:16:07.959061 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:07.959025 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" event={"ID":"f91deec1-3cce-48cb-ad56-54c5d4b60038","Type":"ContainerStarted","Data":"afa956f4b3bea2f7ed72727248e205baadbd34f54cd42d93c3c0d9a23f3a75be"} Jun 14 03:16:07.959484 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:07.959340 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:16:07.959948 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:07.959929 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6c886887c-vgz2v" Jun 14 03:16:07.960758 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:07.960740 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57668dfc54-j2k8j" event={"ID":"089d8b07-adbe-4494-99d6-3d4b12d890e1","Type":"ContainerStarted","Data":"0587c76e52fdd04f54c44e0c560c07e5249fab8cc390310a9ad2aba5d7169af3"} Jun 14 03:16:15.140470 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:15.140417 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:50.446338 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.446282 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w"] Jun 14 03:16:50.448117 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.448101 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.450579 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.450552 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dnjpz\"" Jun 14 03:16:50.450579 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.450554 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 14 03:16:50.450767 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.450554 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 14 03:16:50.450767 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.450552 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 14 03:16:50.451454 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.451440 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 14 03:16:50.452846 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.452825 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-f8ptq"] Jun 14 03:16:50.454653 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.454636 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm"] Jun 14 03:16:50.454774 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.454749 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.456448 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.456432 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.456527 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.456494 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f9df476f9-q92df"] Jun 14 03:16:50.460022 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.460002 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.464575 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.464535 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 14 03:16:50.466923 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.466899 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 14 03:16:50.467107 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.466983 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 14 03:16:50.467188 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.467122 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bdjbh\"" Jun 14 03:16:50.467245 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.466992 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 03:16:50.467299 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.467267 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 14 03:16:50.467351 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.466983 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 14 03:16:50.467402 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.467373 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 14 03:16:50.467784 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.467764 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 14 03:16:50.467970 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.467937 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 14 03:16:50.468149 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.468128 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w"] Jun 14 03:16:50.468991 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.468977 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 03:16:50.469455 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.469437 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 14 03:16:50.469649 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.469630 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wwz6f\"" Jun 14 03:16:50.469743 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.469658 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fgws4\"" Jun 14 03:16:50.473764 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.473730 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 14 03:16:50.474113 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.474094 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 14 03:16:50.476334 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.476312 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-f8ptq"] Jun 14 03:16:50.477106 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.477083 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm"] Jun 14 03:16:50.493937 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.493911 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f9df476f9-q92df"] Jun 14 03:16:50.526047 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.526012 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34dd0143-39a2-425e-a2bf-d44443809763-config\") pod \"service-ca-operator-7ccbfd59dc-2b46w\" (UID: \"34dd0143-39a2-425e-a2bf-d44443809763\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.526047 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.526052 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34dd0143-39a2-425e-a2bf-d44443809763-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-2b46w\" (UID: \"34dd0143-39a2-425e-a2bf-d44443809763\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.526259 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.526113 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2p45\" (UniqueName: \"kubernetes.io/projected/34dd0143-39a2-425e-a2bf-d44443809763-kube-api-access-w2p45\") pod \"service-ca-operator-7ccbfd59dc-2b46w\" (UID: \"34dd0143-39a2-425e-a2bf-d44443809763\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.614975 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.614937 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:50.626967 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.626940 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtspn\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-kube-api-access-mtspn\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.627087 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.626980 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fswm\" (UniqueName: \"kubernetes.io/projected/988f4a36-8720-400e-b3f8-d0d879d82c85-kube-api-access-9fswm\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.627087 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627007 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd7804f-6835-4629-b817-f441cb2ac2ae-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5zppm\" (UID: \"4dd7804f-6835-4629-b817-f441cb2ac2ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.627087 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627031 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2021328c-104b-4369-b6d3-4f9056925bd1-ca-trust-extracted\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.627248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627091 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-trusted-ca\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.627248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627118 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/988f4a36-8720-400e-b3f8-d0d879d82c85-serving-cert\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.627248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627150 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-image-registry-private-configuration\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.627248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627193 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-bound-sa-token\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.627248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627220 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/988f4a36-8720-400e-b3f8-d0d879d82c85-tmp\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.627472 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627254 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-installation-pull-secrets\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.627472 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627305 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-registry-certificates\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.627472 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627336 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2p45\" (UniqueName: \"kubernetes.io/projected/34dd0143-39a2-425e-a2bf-d44443809763-kube-api-access-w2p45\") pod \"service-ca-operator-7ccbfd59dc-2b46w\" (UID: \"34dd0143-39a2-425e-a2bf-d44443809763\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.627472 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627358 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/988f4a36-8720-400e-b3f8-d0d879d82c85-snapshots\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.627472 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627384 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2krsf\" (UniqueName: \"kubernetes.io/projected/4dd7804f-6835-4629-b817-f441cb2ac2ae-kube-api-access-2krsf\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5zppm\" (UID: \"4dd7804f-6835-4629-b817-f441cb2ac2ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.627472 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627434 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34dd0143-39a2-425e-a2bf-d44443809763-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-2b46w\" (UID: \"34dd0143-39a2-425e-a2bf-d44443809763\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.627472 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627467 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34dd0143-39a2-425e-a2bf-d44443809763-config\") pod \"service-ca-operator-7ccbfd59dc-2b46w\" (UID: \"34dd0143-39a2-425e-a2bf-d44443809763\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.627874 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627494 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/988f4a36-8720-400e-b3f8-d0d879d82c85-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.627874 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627513 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.627874 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627538 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/988f4a36-8720-400e-b3f8-d0d879d82c85-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.627874 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.627579 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4dd7804f-6835-4629-b817-f441cb2ac2ae-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5zppm\" (UID: \"4dd7804f-6835-4629-b817-f441cb2ac2ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.628082 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.628065 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/34dd0143-39a2-425e-a2bf-d44443809763-config\") pod \"service-ca-operator-7ccbfd59dc-2b46w\" (UID: \"34dd0143-39a2-425e-a2bf-d44443809763\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.629779 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.629759 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/34dd0143-39a2-425e-a2bf-d44443809763-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-2b46w\" (UID: \"34dd0143-39a2-425e-a2bf-d44443809763\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.635180 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.635158 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2p45\" (UniqueName: \"kubernetes.io/projected/34dd0143-39a2-425e-a2bf-d44443809763-kube-api-access-w2p45\") pod \"service-ca-operator-7ccbfd59dc-2b46w\" (UID: \"34dd0143-39a2-425e-a2bf-d44443809763\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.716015 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.715919 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:50.727936 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.727908 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/988f4a36-8720-400e-b3f8-d0d879d82c85-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.728058 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.727945 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.728058 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.727965 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/988f4a36-8720-400e-b3f8-d0d879d82c85-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.728058 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.727980 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4dd7804f-6835-4629-b817-f441cb2ac2ae-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5zppm\" (UID: \"4dd7804f-6835-4629-b817-f441cb2ac2ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.728058 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728005 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtspn\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-kube-api-access-mtspn\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.728058 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728022 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fswm\" (UniqueName: \"kubernetes.io/projected/988f4a36-8720-400e-b3f8-d0d879d82c85-kube-api-access-9fswm\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.728058 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728038 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd7804f-6835-4629-b817-f441cb2ac2ae-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5zppm\" (UID: \"4dd7804f-6835-4629-b817-f441cb2ac2ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.728058 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728056 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2021328c-104b-4369-b6d3-4f9056925bd1-ca-trust-extracted\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:50.728076 2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728084 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-trusted-ca\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:50.728095 2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f9df476f9-q92df: secret "image-registry-tls" not found Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728113 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/988f4a36-8720-400e-b3f8-d0d879d82c85-serving-cert\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728144 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-image-registry-private-configuration\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:50.728167 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls podName:2021328c-104b-4369-b6d3-4f9056925bd1 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:51.228146402 +0000 UTC m=+234.343760582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls") pod "image-registry-5f9df476f9-q92df" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1") : secret "image-registry-tls" not found Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728207 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-bound-sa-token\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728238 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/988f4a36-8720-400e-b3f8-d0d879d82c85-tmp\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728266 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-installation-pull-secrets\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728313 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-registry-certificates\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728341 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/988f4a36-8720-400e-b3f8-d0d879d82c85-snapshots\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.728403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728369 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2krsf\" (UniqueName: \"kubernetes.io/projected/4dd7804f-6835-4629-b817-f441cb2ac2ae-kube-api-access-2krsf\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5zppm\" (UID: \"4dd7804f-6835-4629-b817-f441cb2ac2ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.729030 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728654 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2021328c-104b-4369-b6d3-4f9056925bd1-ca-trust-extracted\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.729030 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728681 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4dd7804f-6835-4629-b817-f441cb2ac2ae-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5zppm\" (UID: \"4dd7804f-6835-4629-b817-f441cb2ac2ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.729030 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728881 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/988f4a36-8720-400e-b3f8-d0d879d82c85-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.729030 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.728951 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/988f4a36-8720-400e-b3f8-d0d879d82c85-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.729613 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.729240 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/988f4a36-8720-400e-b3f8-d0d879d82c85-tmp\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.729613 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.729557 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/988f4a36-8720-400e-b3f8-d0d879d82c85-snapshots\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.729744 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.729663 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-registry-certificates\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.729940 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.729916 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-trusted-ca\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.730813 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.730768 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dd7804f-6835-4629-b817-f441cb2ac2ae-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5zppm\" (UID: \"4dd7804f-6835-4629-b817-f441cb2ac2ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.730895 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.730848 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-image-registry-private-configuration\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.731219 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.731196 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-installation-pull-secrets\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.731343 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.731326 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/988f4a36-8720-400e-b3f8-d0d879d82c85-serving-cert\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.736494 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.736470 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtspn\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-kube-api-access-mtspn\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.736494 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.736481 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-bound-sa-token\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:50.736620 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.736591 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fswm\" (UniqueName: \"kubernetes.io/projected/988f4a36-8720-400e-b3f8-d0d879d82c85-kube-api-access-9fswm\") pod \"insights-operator-5bbd86d6bd-f8ptq\" (UID: \"988f4a36-8720-400e-b3f8-d0d879d82c85\") " pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.736974 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.736953 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2krsf\" (UniqueName: \"kubernetes.io/projected/4dd7804f-6835-4629-b817-f441cb2ac2ae-kube-api-access-2krsf\") pod \"kube-storage-version-migrator-operator-7c578b78fc-5zppm\" (UID: \"4dd7804f-6835-4629-b817-f441cb2ac2ae\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.757147 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.757125 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" Jun 14 03:16:50.770104 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.770082 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" Jun 14 03:16:50.777792 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.777776 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" Jun 14 03:16:50.894340 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.894312 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w"] Jun 14 03:16:50.898175 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:16:50.897793 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34dd0143_39a2_425e_a2bf_d44443809763.slice/crio-352c1dbdb1c988df32ea8d94fd3001140a28839f7fe2e206a8b81edd6f020482 WatchSource:0}: Error finding container 352c1dbdb1c988df32ea8d94fd3001140a28839f7fe2e206a8b81edd6f020482: Status 404 returned error can't find the container with id 352c1dbdb1c988df32ea8d94fd3001140a28839f7fe2e206a8b81edd6f020482 Jun 14 03:16:50.908596 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.908565 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-f8ptq"] Jun 14 03:16:50.911375 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:16:50.911348 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988f4a36_8720_400e_b3f8_d0d879d82c85.slice/crio-82dcfd04a4e82be33505b72eb4a6e21c8f7a4701f54cbfedb0a5bd3587bd4dff WatchSource:0}: Error finding container 82dcfd04a4e82be33505b72eb4a6e21c8f7a4701f54cbfedb0a5bd3587bd4dff: Status 404 returned error can't find the container with id 82dcfd04a4e82be33505b72eb4a6e21c8f7a4701f54cbfedb0a5bd3587bd4dff Jun 14 03:16:50.925507 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:50.925478 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm"] Jun 14 03:16:50.928838 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:16:50.928815 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dd7804f_6835_4629_b817_f441cb2ac2ae.slice/crio-23951d220acc6693b9611af0df703ec110913004cd6915d858efd7f0f64736df WatchSource:0}: Error finding container 23951d220acc6693b9611af0df703ec110913004cd6915d858efd7f0f64736df: Status 404 returned error can't find the container with id 23951d220acc6693b9611af0df703ec110913004cd6915d858efd7f0f64736df Jun 14 03:16:51.079138 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:51.079042 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" event={"ID":"988f4a36-8720-400e-b3f8-d0d879d82c85","Type":"ContainerStarted","Data":"82dcfd04a4e82be33505b72eb4a6e21c8f7a4701f54cbfedb0a5bd3587bd4dff"} Jun 14 03:16:51.079960 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:51.079939 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" event={"ID":"4dd7804f-6835-4629-b817-f441cb2ac2ae","Type":"ContainerStarted","Data":"23951d220acc6693b9611af0df703ec110913004cd6915d858efd7f0f64736df"} Jun 14 03:16:51.080865 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:51.080847 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" event={"ID":"34dd0143-39a2-425e-a2bf-d44443809763","Type":"ContainerStarted","Data":"352c1dbdb1c988df32ea8d94fd3001140a28839f7fe2e206a8b81edd6f020482"} Jun 14 03:16:51.232146 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:51.232077 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:51.232334 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:51.232233 2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 03:16:51.232334 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:51.232254 2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f9df476f9-q92df: secret "image-registry-tls" not found Jun 14 03:16:51.232334 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:51.232313 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls podName:2021328c-104b-4369-b6d3-4f9056925bd1 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:52.23229354 +0000 UTC m=+235.347907732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls") pod "image-registry-5f9df476f9-q92df" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1") : secret "image-registry-tls" not found Jun 14 03:16:52.241301 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:52.241260 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:52.241787 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:52.241447 2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 03:16:52.241787 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:52.241465 2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f9df476f9-q92df: secret "image-registry-tls" not found Jun 14 03:16:52.241787 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:52.241537 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls podName:2021328c-104b-4369-b6d3-4f9056925bd1 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:54.241504901 +0000 UTC m=+237.357119103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls") pod "image-registry-5f9df476f9-q92df" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1") : secret "image-registry-tls" not found Jun 14 03:16:52.525028 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:52.524946 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:52.577718 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:52.577682 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:54.093687 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:54.093590 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" event={"ID":"4dd7804f-6835-4629-b817-f441cb2ac2ae","Type":"ContainerStarted","Data":"ebca5ac8b341b68b1f243f369d0a711243378ca99774fb86363f3a1b1e5e5b1e"} Jun 14 03:16:54.095209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:54.095182 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" event={"ID":"34dd0143-39a2-425e-a2bf-d44443809763","Type":"ContainerStarted","Data":"eb36d5954b8b55e88c7b82215e354f13142455e51dc8f91d57afb5d9edbc9f62"} Jun 14 03:16:54.096843 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:54.096782 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" event={"ID":"988f4a36-8720-400e-b3f8-d0d879d82c85","Type":"ContainerStarted","Data":"cde37379d9422dcbd2e7d2d27062a64bdb7e0a9ed6f52bbb287f41daf9781c7b"} Jun 14 03:16:54.108160 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:54.108111 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" podStartSLOduration=1.3260636909999999 podStartE2EDuration="4.10809547s" totalImagesPullingTime="2.782031779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:16:54.107641261 +0000 UTC m=+237.223255464" watchObservedRunningTime="2026-06-14 03:16:54.10809547 +0000 UTC m=+237.223709669" Jun 14 03:16:54.121974 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:54.121919 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" podStartSLOduration=1.315325566 podStartE2EDuration="4.121899995s" totalImagesPullingTime="2.806574429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:16:54.121422105 +0000 UTC m=+237.237036321" watchObservedRunningTime="2026-06-14 03:16:54.121899995 +0000 UTC m=+237.237514195" Jun 14 03:16:54.138010 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:54.137952 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" podStartSLOduration=1.339199922 podStartE2EDuration="4.137935689s" totalImagesPullingTime="2.798735767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:16:54.137639406 +0000 UTC m=+237.253253607" watchObservedRunningTime="2026-06-14 03:16:54.137935689 +0000 UTC m=+237.253550207" Jun 14 03:16:54.259488 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:54.259146 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:54.259488 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:54.259483 2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 03:16:54.259717 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:54.259502 2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f9df476f9-q92df: secret "image-registry-tls" not found Jun 14 03:16:54.259717 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:54.259565 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls podName:2021328c-104b-4369-b6d3-4f9056925bd1 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:58.259547165 +0000 UTC m=+241.375161357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls") pod "image-registry-5f9df476f9-q92df" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1") : secret "image-registry-tls" not found Jun 14 03:16:55.043547 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.043511 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:55.142011 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.141971 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:55.239811 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.239763 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:55.504896 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.504864 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vnb6w"] Jun 14 03:16:55.507737 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.507705 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.510028 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.510007 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 03:16:55.510302 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.510283 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 03:16:55.510363 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.510347 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7kdg\"" Jun 14 03:16:55.517888 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.517867 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vnb6w"] Jun 14 03:16:55.533618 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.533588 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:55.583069 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.583004 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:55.671289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.671250 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59f5a884-8035-4b95-82dd-43d852324113-data-volume\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.671289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.671288 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np2pv\" (UniqueName: \"kubernetes.io/projected/59f5a884-8035-4b95-82dd-43d852324113-kube-api-access-np2pv\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.671517 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.671311 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.671517 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.671332 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59f5a884-8035-4b95-82dd-43d852324113-crio-socket\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.671517 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.671468 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.771862 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.771765 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59f5a884-8035-4b95-82dd-43d852324113-data-volume\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.771862 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.771829 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np2pv\" (UniqueName: \"kubernetes.io/projected/59f5a884-8035-4b95-82dd-43d852324113-kube-api-access-np2pv\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.771862 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.771859 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.772125 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.771892 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59f5a884-8035-4b95-82dd-43d852324113-crio-socket\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.772125 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:55.771970 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 03:16:55.772125 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.771988 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.772125 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.772047 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/59f5a884-8035-4b95-82dd-43d852324113-crio-socket\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.772125 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:55.772050 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm podName:59f5a884-8035-4b95-82dd-43d852324113 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:56.27202892 +0000 UTC m=+239.387643117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vnb6w" (UID: "59f5a884-8035-4b95-82dd-43d852324113") : configmap "kube-rbac-proxy" not found Jun 14 03:16:55.772125 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:55.772102 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 03:16:55.772333 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:55.772159 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls podName:59f5a884-8035-4b95-82dd-43d852324113 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:56.272143473 +0000 UTC m=+239.387757672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnb6w" (UID: "59f5a884-8035-4b95-82dd-43d852324113") : secret "insights-runtime-extractor-tls" not found Jun 14 03:16:55.772333 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.772103 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/59f5a884-8035-4b95-82dd-43d852324113-data-volume\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.785350 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.785326 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np2pv\" (UniqueName: \"kubernetes.io/projected/59f5a884-8035-4b95-82dd-43d852324113-kube-api-access-np2pv\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:55.812274 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.812246 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:55.912995 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:55.912963 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:56.275471 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:56.275442 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:56.275876 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:56.275487 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:56.275876 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:56.275551 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 03:16:56.275876 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:56.275599 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 03:16:56.275876 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:56.275603 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm podName:59f5a884-8035-4b95-82dd-43d852324113 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:57.275588599 +0000 UTC m=+240.391202777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vnb6w" (UID: "59f5a884-8035-4b95-82dd-43d852324113") : configmap "kube-rbac-proxy" not found Jun 14 03:16:56.275876 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:56.275663 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls podName:59f5a884-8035-4b95-82dd-43d852324113 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:57.275648663 +0000 UTC m=+240.391262840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnb6w" (UID: "59f5a884-8035-4b95-82dd-43d852324113") : secret "insights-runtime-extractor-tls" not found Jun 14 03:16:57.283158 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:57.283128 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:57.283510 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:57.283171 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:57.283510 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:57.283285 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 03:16:57.283510 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:57.283301 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 03:16:57.283510 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:57.283327 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm podName:59f5a884-8035-4b95-82dd-43d852324113 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:59.283315585 +0000 UTC m=+242.398929762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vnb6w" (UID: "59f5a884-8035-4b95-82dd-43d852324113") : configmap "kube-rbac-proxy" not found Jun 14 03:16:57.283510 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:57.283360 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls podName:59f5a884-8035-4b95-82dd-43d852324113 nodeName:}" failed. No retries permitted until 2026-06-14 03:16:59.283342502 +0000 UTC m=+242.398956683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnb6w" (UID: "59f5a884-8035-4b95-82dd-43d852324113") : secret "insights-runtime-extractor-tls" not found Jun 14 03:16:57.444059 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:57.444010 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:57.545008 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:57.544926 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:57.645470 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:57.645436 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:58.277712 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:58.277682 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:16:58.290987 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:58.290958 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:16:58.291400 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:58.291134 2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 14 03:16:58.291400 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:58.291153 2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f9df476f9-q92df: secret "image-registry-tls" not found Jun 14 03:16:58.291400 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:58.291219 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls podName:2021328c-104b-4369-b6d3-4f9056925bd1 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:06.291196785 +0000 UTC m=+249.406810981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls") pod "image-registry-5f9df476f9-q92df" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1") : secret "image-registry-tls" not found Jun 14 03:16:58.503891 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:58.503865 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-slkjx_2f4685d5-520b-4fad-bb63-a3020ec632a1/dns-node-resolver/0.log" Jun 14 03:16:59.298589 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:59.298562 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qrlfx_d746952d-090b-4847-b215-57c2cc49a738/node-ca/0.log" Jun 14 03:16:59.299841 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:59.299795 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:59.299912 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:59.299864 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 03:16:59.299949 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:59.299919 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm podName:59f5a884-8035-4b95-82dd-43d852324113 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:03.299905369 +0000 UTC m=+246.415519549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vnb6w" (UID: "59f5a884-8035-4b95-82dd-43d852324113") : configmap "kube-rbac-proxy" not found Jun 14 03:16:59.299949 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:16:59.299936 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:16:59.300052 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:59.300042 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 03:16:59.300093 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:16:59.300074 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls podName:59f5a884-8035-4b95-82dd-43d852324113 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:03.300066077 +0000 UTC m=+246.415680254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnb6w" (UID: "59f5a884-8035-4b95-82dd-43d852324113") : secret "insights-runtime-extractor-tls" not found Jun 14 03:17:00.298261 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:00.298236 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qt8pz_c0f6c0a1-34ad-4271-853b-fb196399dd18/serve-healthcheck-canary/0.log" Jun 14 03:17:00.787084 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:00.787050 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:00.844136 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:00.844101 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:00.911136 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:00.911104 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-5zppm_4dd7804f-6835-4629-b817-f441cb2ac2ae/kube-storage-version-migrator-operator/0.log" Jun 14 03:17:00.972869 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:00.972835 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:01.190054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:01.190020 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:01.293513 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:01.293482 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:01.399117 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:01.399086 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:01.496585 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:01.496499 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:01.554423 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:01.554385 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:02.099796 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:02.099762 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:02.485857 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:02.485825 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:03.086527 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:03.086490 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:03.328555 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:03.328504 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:17:03.329025 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:03.328581 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:17:03.329025 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:17:03.328645 2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 03:17:03.329025 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:17:03.328670 2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 03:17:03.329025 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:17:03.328712 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls podName:59f5a884-8035-4b95-82dd-43d852324113 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:11.328696656 +0000 UTC m=+254.444310834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vnb6w" (UID: "59f5a884-8035-4b95-82dd-43d852324113") : secret "insights-runtime-extractor-tls" not found Jun 14 03:17:03.329025 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:17:03.328726 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm podName:59f5a884-8035-4b95-82dd-43d852324113 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:11.328719978 +0000 UTC m=+254.444334155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vnb6w" (UID: "59f5a884-8035-4b95-82dd-43d852324113") : configmap "kube-rbac-proxy" not found Jun 14 03:17:03.489415 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:03.489381 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:03.703822 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:03.703772 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:04.085335 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:04.085297 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:04.683289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:04.683251 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:04.738986 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:04.738949 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:05.084418 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:05.084331 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:05.287356 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:05.287322 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:05.686542 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:05.686509 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:06.285085 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:06.285059 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:06.351368 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:06.351327 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:17:06.353671 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:06.353646 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls\") pod \"image-registry-5f9df476f9-q92df\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:17:06.385928 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:06.385906 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fgws4\"" Jun 14 03:17:06.393931 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:06.393913 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:17:06.519249 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:06.519216 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f9df476f9-q92df"] Jun 14 03:17:06.522497 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:17:06.522470 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2021328c_104b_4369_b6d3_4f9056925bd1.slice/crio-a7702a82643bc6ef47d330af8346c46ed143e32ef84706679a1ea44216a80d2b WatchSource:0}: Error finding container a7702a82643bc6ef47d330af8346c46ed143e32ef84706679a1ea44216a80d2b: Status 404 returned error can't find the container with id a7702a82643bc6ef47d330af8346c46ed143e32ef84706679a1ea44216a80d2b Jun 14 03:17:06.886653 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:06.886540 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:07.093164 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:07.093134 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:07.139206 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:07.139119 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" event={"ID":"2021328c-104b-4369-b6d3-4f9056925bd1","Type":"ContainerStarted","Data":"6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03"} Jun 14 03:17:07.139206 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:07.139173 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" event={"ID":"2021328c-104b-4369-b6d3-4f9056925bd1","Type":"ContainerStarted","Data":"a7702a82643bc6ef47d330af8346c46ed143e32ef84706679a1ea44216a80d2b"} Jun 14 03:17:07.139420 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:07.139252 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:17:07.159189 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:07.159145 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" podStartSLOduration=17.159129101 podStartE2EDuration="17.159129101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:16:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:07.157290994 +0000 UTC m=+250.272905205" watchObservedRunningTime="2026-06-14 03:17:07.159129101 +0000 UTC m=+250.274743299" Jun 14 03:17:07.321692 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:07.321645 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:07.481779 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:07.481748 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:07.681585 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:07.681558 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:07.888284 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:07.888193 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:08.087495 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:08.087445 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:08.681531 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:08.681482 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:09.085690 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:09.085596 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:09.173764 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:09.173713 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:17:09.176110 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:09.176080 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ece5ab3c-1b05-4071-a849-e437253af84f-metrics-certs\") pod \"network-metrics-daemon-d6lrk\" (UID: \"ece5ab3c-1b05-4071-a849-e437253af84f\") " pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:17:09.211693 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:09.211660 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:09.438597 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:09.438571 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6hmrz\"" Jun 14 03:17:09.446577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:09.446554 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d6lrk" Jun 14 03:17:09.490857 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:09.490789 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:09.573000 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:09.572970 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d6lrk"] Jun 14 03:17:09.576067 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:17:09.576038 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece5ab3c_1b05_4071_a849_e437253af84f.slice/crio-c889611c161ab0a2314a12fe2724b4b7a83cc37320d521cd6858776e4e502d41 WatchSource:0}: Error finding container c889611c161ab0a2314a12fe2724b4b7a83cc37320d521cd6858776e4e502d41: Status 404 returned error can't find the container with id c889611c161ab0a2314a12fe2724b4b7a83cc37320d521cd6858776e4e502d41 Jun 14 03:17:09.885352 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:09.885255 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:10.093586 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:10.093555 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:10.149325 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:10.149236 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d6lrk" event={"ID":"ece5ab3c-1b05-4071-a849-e437253af84f","Type":"ContainerStarted","Data":"c889611c161ab0a2314a12fe2724b4b7a83cc37320d521cd6858776e4e502d41"} Jun 14 03:17:10.479665 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:10.479631 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:11.081505 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.081473 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:11.154027 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.153997 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d6lrk" event={"ID":"ece5ab3c-1b05-4071-a849-e437253af84f","Type":"ContainerStarted","Data":"8af8efbe83179fee17998384be175e8ebbc02032f82b31a716e27866de69927b"} Jun 14 03:17:11.154510 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.154045 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d6lrk" event={"ID":"ece5ab3c-1b05-4071-a849-e437253af84f","Type":"ContainerStarted","Data":"12d7bbd35b61f7133f00d2487577648b90307f4b30a9052cd7dd38732a24c5f7"} Jun 14 03:17:11.169544 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.169489 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d6lrk" podStartSLOduration=253.192497303 podStartE2EDuration="4m14.169470549s" totalImagesPullingTime="976.973246ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:11.168948647 +0000 UTC m=+254.284562846" watchObservedRunningTime="2026-06-14 03:17:11.169470549 +0000 UTC m=+254.285084748" Jun 14 03:17:11.294545 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.294510 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:11.390871 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.390770 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:17:11.390871 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.390846 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:17:11.391337 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.391309 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/59f5a884-8035-4b95-82dd-43d852324113-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:17:11.393152 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.393132 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/59f5a884-8035-4b95-82dd-43d852324113-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vnb6w\" (UID: \"59f5a884-8035-4b95-82dd-43d852324113\") " pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:17:11.419783 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.419750 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7kdg\"" Jun 14 03:17:11.427721 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.427703 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vnb6w" Jun 14 03:17:11.481289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.481256 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:11.553909 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:11.553878 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vnb6w"] Jun 14 03:17:11.557083 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:17:11.557057 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f5a884_8035_4b95_82dd_43d852324113.slice/crio-bb04c2bfc8d0bc80b5162a9732f8ad278bffc401f84e5339072216bea341f100 WatchSource:0}: Error finding container bb04c2bfc8d0bc80b5162a9732f8ad278bffc401f84e5339072216bea341f100: Status 404 returned error can't find the container with id bb04c2bfc8d0bc80b5162a9732f8ad278bffc401f84e5339072216bea341f100 Jun 14 03:17:12.161721 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:12.161680 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vnb6w" event={"ID":"59f5a884-8035-4b95-82dd-43d852324113","Type":"ContainerStarted","Data":"bb04c2bfc8d0bc80b5162a9732f8ad278bffc401f84e5339072216bea341f100"} Jun 14 03:17:14.179182 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:14.179152 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:14.233176 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:14.233150 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:15.172621 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:15.172534 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vnb6w" event={"ID":"59f5a884-8035-4b95-82dd-43d852324113","Type":"ContainerStarted","Data":"c257eb1a481b80b275b32c1f387ff82e33bdf3017e238a75366b0dd1751c0535"} Jun 14 03:17:16.177843 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.177790 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vnb6w" event={"ID":"59f5a884-8035-4b95-82dd-43d852324113","Type":"ContainerStarted","Data":"95b20f0f92c13f69dde6f40dcad85bebd7d0cf07e2696f9d73bacbd42c5a546e"} Jun 14 03:17:16.669250 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.669164 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f9df476f9-q92df"] Jun 14 03:17:16.731631 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.731582 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-565c584dd-lg8s7"] Jun 14 03:17:16.734717 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.734698 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.751876 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.751840 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-565c584dd-lg8s7"] Jun 14 03:17:16.792008 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.791976 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:16.837272 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.837237 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de8d6d0b-3347-47b6-8bf1-ffe970a48072-installation-pull-secrets\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.837454 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.837297 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de8d6d0b-3347-47b6-8bf1-ffe970a48072-image-registry-private-configuration\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.837454 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.837343 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxbvm\" (UniqueName: \"kubernetes.io/projected/de8d6d0b-3347-47b6-8bf1-ffe970a48072-kube-api-access-fxbvm\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.837454 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.837371 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de8d6d0b-3347-47b6-8bf1-ffe970a48072-registry-tls\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.837454 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.837450 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de8d6d0b-3347-47b6-8bf1-ffe970a48072-registry-certificates\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.837651 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.837473 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de8d6d0b-3347-47b6-8bf1-ffe970a48072-bound-sa-token\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.837651 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.837524 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de8d6d0b-3347-47b6-8bf1-ffe970a48072-ca-trust-extracted\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.837651 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.837554 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de8d6d0b-3347-47b6-8bf1-ffe970a48072-trusted-ca\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.892641 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.892610 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:16.938026 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.937931 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de8d6d0b-3347-47b6-8bf1-ffe970a48072-trusted-ca\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.938026 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.937974 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de8d6d0b-3347-47b6-8bf1-ffe970a48072-installation-pull-secrets\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.938257 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.938085 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de8d6d0b-3347-47b6-8bf1-ffe970a48072-image-registry-private-configuration\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.938257 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.938155 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxbvm\" (UniqueName: \"kubernetes.io/projected/de8d6d0b-3347-47b6-8bf1-ffe970a48072-kube-api-access-fxbvm\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.938257 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.938184 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de8d6d0b-3347-47b6-8bf1-ffe970a48072-registry-tls\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.938257 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.938238 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de8d6d0b-3347-47b6-8bf1-ffe970a48072-registry-certificates\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.938455 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.938265 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de8d6d0b-3347-47b6-8bf1-ffe970a48072-bound-sa-token\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.938455 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.938313 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de8d6d0b-3347-47b6-8bf1-ffe970a48072-ca-trust-extracted\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.938762 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.938730 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de8d6d0b-3347-47b6-8bf1-ffe970a48072-ca-trust-extracted\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.939372 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.939344 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de8d6d0b-3347-47b6-8bf1-ffe970a48072-registry-certificates\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.939620 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.939593 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de8d6d0b-3347-47b6-8bf1-ffe970a48072-trusted-ca\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.941145 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.941112 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de8d6d0b-3347-47b6-8bf1-ffe970a48072-installation-pull-secrets\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.941248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.941227 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de8d6d0b-3347-47b6-8bf1-ffe970a48072-registry-tls\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.941680 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.941659 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de8d6d0b-3347-47b6-8bf1-ffe970a48072-image-registry-private-configuration\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.948576 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.948546 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de8d6d0b-3347-47b6-8bf1-ffe970a48072-bound-sa-token\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.949501 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.949464 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxbvm\" (UniqueName: \"kubernetes.io/projected/de8d6d0b-3347-47b6-8bf1-ffe970a48072-kube-api-access-fxbvm\") pod \"image-registry-565c584dd-lg8s7\" (UID: \"de8d6d0b-3347-47b6-8bf1-ffe970a48072\") " pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:16.991919 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:16.991886 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:17.044945 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:17.044900 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:17.294887 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:17.294779 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-565c584dd-lg8s7"] Jun 14 03:17:17.297157 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:17:17.297130 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8d6d0b_3347_47b6_8bf1_ffe970a48072.slice/crio-552a802286638d79d1573ee2b5b1817ea8eb863b461e05d0530372aacce9e950 WatchSource:0}: Error finding container 552a802286638d79d1573ee2b5b1817ea8eb863b461e05d0530372aacce9e950: Status 404 returned error can't find the container with id 552a802286638d79d1573ee2b5b1817ea8eb863b461e05d0530372aacce9e950 Jun 14 03:17:18.186213 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:18.186173 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vnb6w" event={"ID":"59f5a884-8035-4b95-82dd-43d852324113","Type":"ContainerStarted","Data":"7ab5eae79d38ea95c5623d03a7e0556cf48236ef983e9292f896863727ac6ebc"} Jun 14 03:17:18.187542 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:18.187518 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-565c584dd-lg8s7" event={"ID":"de8d6d0b-3347-47b6-8bf1-ffe970a48072","Type":"ContainerStarted","Data":"deea30b023d716d242fa7e424968dc3e5494e0b374046de64ef5f488562bcf69"} Jun 14 03:17:18.187647 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:18.187555 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-565c584dd-lg8s7" event={"ID":"de8d6d0b-3347-47b6-8bf1-ffe970a48072","Type":"ContainerStarted","Data":"552a802286638d79d1573ee2b5b1817ea8eb863b461e05d0530372aacce9e950"} Jun 14 03:17:18.187647 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:18.187631 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:18.213450 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:18.211392 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vnb6w" podStartSLOduration=17.656023765 podStartE2EDuration="23.211372141s" totalImagesPullingTime="5.555348376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:16:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:18.210393123 +0000 UTC m=+261.326007324" watchObservedRunningTime="2026-06-14 03:17:18.211372141 +0000 UTC m=+261.326986341" Jun 14 03:17:18.232359 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:18.232308 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-565c584dd-lg8s7" podStartSLOduration=2.232293713 podStartE2EDuration="2.232293713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:18.231292485 +0000 UTC m=+261.346906683" watchObservedRunningTime="2026-06-14 03:17:18.232293713 +0000 UTC m=+261.347907912" Jun 14 03:17:22.621462 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:22.621425 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:22.721889 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:22.721851 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:24.195275 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:24.195240 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:24.303602 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:24.303571 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:24.396380 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:24.396352 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:24.497955 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:24.497869 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:24.663969 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:24.663939 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:24.772403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:24.772325 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:24.865735 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:24.865704 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:26.674314 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:26.674272 2547 patch_prober.go:28] interesting pod/image-registry-5f9df476f9-q92df container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 03:17:26.674689 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:26.674335 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" podUID="2021328c-104b-4369-b6d3-4f9056925bd1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 03:17:27.519092 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:27.519060 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:27.583167 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:27.583138 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:27.636690 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:27.636657 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:29.380963 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:29.380922 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:31.647053 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.647026 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:31.860588 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.860551 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:31.881779 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.881750 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z79pf"] Jun 14 03:17:31.885129 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.885114 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:31.890172 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.890149 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 03:17:31.890326 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.890196 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 03:17:31.890326 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.890174 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 03:17:31.890326 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.890216 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 03:17:31.890326 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.890231 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 03:17:31.890326 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.890247 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wf949\"" Jun 14 03:17:31.890326 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.890202 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 03:17:31.899576 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.899527 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-v9frh"] Jun 14 03:17:31.901751 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.901738 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:31.904389 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.904373 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 14 03:17:31.904435 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.904377 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gtq2l\"" Jun 14 03:17:31.904435 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.904400 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 14 03:17:31.905045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.905025 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 14 03:17:31.915892 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.915867 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-v9frh"] Jun 14 03:17:31.944710 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.944684 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:31.951377 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951356 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-tls\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:31.951498 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951382 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-wtmp\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:31.951498 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951399 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:31.951498 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951417 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca8e72d4-1de1-4b52-8ca7-ee946e745661-sys\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:31.951498 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951440 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-textfile\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:31.951498 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951465 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca8e72d4-1de1-4b52-8ca7-ee946e745661-metrics-client-ca\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:31.951498 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951483 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:31.951674 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951510 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca8e72d4-1de1-4b52-8ca7-ee946e745661-root\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:31.951674 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951568 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-accelerators-collector-config\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:31.951674 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951607 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr9rc\" (UniqueName: \"kubernetes.io/projected/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-api-access-dr9rc\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:31.951674 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951648 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:31.951674 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951663 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:31.951833 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951686 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqvbh\" (UniqueName: \"kubernetes.io/projected/ca8e72d4-1de1-4b52-8ca7-ee946e745661-kube-api-access-kqvbh\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:31.951833 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951701 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c0ff60d-21c8-4644-9dbd-49128a980604-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:31.951833 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:31.951719 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1c0ff60d-21c8-4644-9dbd-49128a980604-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.012371 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.012336 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:32.052753 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.052721 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-tls\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.052876 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.052758 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-wtmp\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.052876 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.052776 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.052876 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.052794 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca8e72d4-1de1-4b52-8ca7-ee946e745661-sys\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.052876 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.052835 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-textfile\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.053054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.052906 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca8e72d4-1de1-4b52-8ca7-ee946e745661-sys\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.053054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.052947 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca8e72d4-1de1-4b52-8ca7-ee946e745661-metrics-client-ca\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.053054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.052950 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-wtmp\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.053054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.052977 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.053054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053038 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca8e72d4-1de1-4b52-8ca7-ee946e745661-root\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.053278 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053073 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-accelerators-collector-config\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.053278 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053118 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr9rc\" (UniqueName: \"kubernetes.io/projected/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-api-access-dr9rc\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.053278 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053186 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-textfile\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.053278 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053192 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.053278 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053117 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca8e72d4-1de1-4b52-8ca7-ee946e745661-root\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.053278 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053217 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.053278 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053262 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqvbh\" (UniqueName: \"kubernetes.io/projected/ca8e72d4-1de1-4b52-8ca7-ee946e745661-kube-api-access-kqvbh\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.053607 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053286 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c0ff60d-21c8-4644-9dbd-49128a980604-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.053607 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:17:32.053422 2547 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 14 03:17:32.053607 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:17:32.053541 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-tls podName:1c0ff60d-21c8-4644-9dbd-49128a980604 nodeName:}" failed. No retries permitted until 2026-06-14 03:17:32.553523547 +0000 UTC m=+275.669137732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-v9frh" (UID: "1c0ff60d-21c8-4644-9dbd-49128a980604") : secret "kube-state-metrics-tls" not found Jun 14 03:17:32.053607 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053542 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca8e72d4-1de1-4b52-8ca7-ee946e745661-metrics-client-ca\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.053825 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053674 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1c0ff60d-21c8-4644-9dbd-49128a980604-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.053825 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.053707 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.054060 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.054041 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1c0ff60d-21c8-4644-9dbd-49128a980604-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.054118 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.054095 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-accelerators-collector-config\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.054293 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.054268 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c0ff60d-21c8-4644-9dbd-49128a980604-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.055677 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.055652 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-tls\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.055677 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.055666 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca8e72d4-1de1-4b52-8ca7-ee946e745661-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.056004 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.055984 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.061766 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.061743 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqvbh\" (UniqueName: \"kubernetes.io/projected/ca8e72d4-1de1-4b52-8ca7-ee946e745661-kube-api-access-kqvbh\") pod \"node-exporter-z79pf\" (UID: \"ca8e72d4-1de1-4b52-8ca7-ee946e745661\") " pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.062202 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.062184 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr9rc\" (UniqueName: \"kubernetes.io/projected/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-api-access-dr9rc\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.114009 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.113978 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:32.195175 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.195146 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z79pf" Jun 14 03:17:32.204929 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:17:32.204901 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca8e72d4_1de1_4b52_8ca7_ee946e745661.slice/crio-042fb77b80e0d75ae9935776dfa12d36af95e64f33a9fc8a5244b8f8bbd0189e WatchSource:0}: Error finding container 042fb77b80e0d75ae9935776dfa12d36af95e64f33a9fc8a5244b8f8bbd0189e: Status 404 returned error can't find the container with id 042fb77b80e0d75ae9935776dfa12d36af95e64f33a9fc8a5244b8f8bbd0189e Jun 14 03:17:32.213192 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.213167 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:32.234768 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.234741 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z79pf" event={"ID":"ca8e72d4-1de1-4b52-8ca7-ee946e745661","Type":"ContainerStarted","Data":"042fb77b80e0d75ae9935776dfa12d36af95e64f33a9fc8a5244b8f8bbd0189e"} Jun 14 03:17:32.312952 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.312921 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:32.413386 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.413355 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:32.533249 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.533162 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:32.558378 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.558350 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.560692 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.560672 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c0ff60d-21c8-4644-9dbd-49128a980604-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-v9frh\" (UID: \"1c0ff60d-21c8-4644-9dbd-49128a980604\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.810188 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.810096 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" Jun 14 03:17:32.868044 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.867870 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:32.944348 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.944319 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:32.948795 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:32.948643 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-v9frh"] Jun 14 03:17:33.049031 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:17:33.049000 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0ff60d_21c8_4644_9dbd_49128a980604.slice/crio-dc7a266b3bfb934a4515770928586957589eb3fd20fe867e5a24fd4d0c84304d WatchSource:0}: Error finding container dc7a266b3bfb934a4515770928586957589eb3fd20fe867e5a24fd4d0c84304d: Status 404 returned error can't find the container with id dc7a266b3bfb934a4515770928586957589eb3fd20fe867e5a24fd4d0c84304d Jun 14 03:17:33.167337 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:33.167311 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:33.240250 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:33.240219 2547 generic.go:356] "Generic (PLEG): container finished" podID="ca8e72d4-1de1-4b52-8ca7-ee946e745661" containerID="f1563d5b1c898d271b7b68885b4df8d418d20f333a53fc3b7f2e557795ca67ac" exitCode=0 Jun 14 03:17:33.240368 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:33.240304 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z79pf" event={"ID":"ca8e72d4-1de1-4b52-8ca7-ee946e745661","Type":"ContainerDied","Data":"f1563d5b1c898d271b7b68885b4df8d418d20f333a53fc3b7f2e557795ca67ac"} Jun 14 03:17:33.241465 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:33.241445 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" event={"ID":"1c0ff60d-21c8-4644-9dbd-49128a980604","Type":"ContainerStarted","Data":"dc7a266b3bfb934a4515770928586957589eb3fd20fe867e5a24fd4d0c84304d"} Jun 14 03:17:34.248370 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:34.248334 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z79pf" event={"ID":"ca8e72d4-1de1-4b52-8ca7-ee946e745661","Type":"ContainerStarted","Data":"6ebda2f98d5951493c6adfba1225ac725b27f8d280935ce988086d822e626eab"} Jun 14 03:17:34.248762 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:34.248442 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z79pf" event={"ID":"ca8e72d4-1de1-4b52-8ca7-ee946e745661","Type":"ContainerStarted","Data":"a6b44cd18466494f1e82824ca579fd71e62964ce7ebb87efbe5354931f2cd415"} Jun 14 03:17:34.250567 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:34.250528 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" event={"ID":"1c0ff60d-21c8-4644-9dbd-49128a980604","Type":"ContainerStarted","Data":"a655232721b1f9454e0957f4e3cd61b14157b75c66c418500bafefdcfd11dc32"} Jun 14 03:17:34.269897 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:34.269790 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z79pf" podStartSLOduration=2.339148497 podStartE2EDuration="3.269768885s" totalImagesPullingTime="866.628662ms" totalInitContainerRuntime="63.991726ms" isStatefulPod=true podCreationTimestamp="2026-06-14 03:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:34.267324528 +0000 UTC m=+277.382938726" watchObservedRunningTime="2026-06-14 03:17:34.269768885 +0000 UTC m=+277.385383085" Jun 14 03:17:34.818659 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:34.818629 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:34.871589 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:34.871554 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:34.943420 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:34.943390 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:35.027618 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:35.027583 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:35.255678 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:35.255633 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" event={"ID":"1c0ff60d-21c8-4644-9dbd-49128a980604","Type":"ContainerStarted","Data":"7827a5978873d5f26600c1a70f331f8c7073027ef60d126a8eceedeefd69e5f4"} Jun 14 03:17:35.256092 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:35.255700 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" event={"ID":"1c0ff60d-21c8-4644-9dbd-49128a980604","Type":"ContainerStarted","Data":"add299f55d49ae3eb52d8541507b7563c4274a4e8497c63d36e5b406eab11ee4"} Jun 14 03:17:35.281602 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:35.281551 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-v9frh" podStartSLOduration=3.186764062 podStartE2EDuration="4.281535573s" totalImagesPullingTime="1.094771511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:35.281026468 +0000 UTC m=+278.396640670" watchObservedRunningTime="2026-06-14 03:17:35.281535573 +0000 UTC m=+278.397149771" Jun 14 03:17:36.186712 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.186674 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-86885df98-szk9w"] Jun 14 03:17:36.188905 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.188879 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.192251 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.192230 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 14 03:17:36.192251 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.192230 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-w9kvq\"" Jun 14 03:17:36.192422 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.192280 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 14 03:17:36.192422 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.192230 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 14 03:17:36.192422 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.192248 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 14 03:17:36.192616 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.192601 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-15ptlp3fikdbl\"" Jun 14 03:17:36.200039 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.200018 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86885df98-szk9w"] Jun 14 03:17:36.290496 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.290453 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1234228-0c89-4eaa-8675-9128af02dae8-secret-metrics-server-client-certs\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.290496 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.290498 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1234228-0c89-4eaa-8675-9128af02dae8-audit-log\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.290933 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.290530 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9kb6\" (UniqueName: \"kubernetes.io/projected/b1234228-0c89-4eaa-8675-9128af02dae8-kube-api-access-q9kb6\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.290933 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.290590 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1234228-0c89-4eaa-8675-9128af02dae8-secret-metrics-server-tls\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.290933 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.290607 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1234228-0c89-4eaa-8675-9128af02dae8-client-ca-bundle\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.290933 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.290636 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1234228-0c89-4eaa-8675-9128af02dae8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.290933 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.290661 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1234228-0c89-4eaa-8675-9128af02dae8-metrics-server-audit-profiles\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.391941 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.391909 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1234228-0c89-4eaa-8675-9128af02dae8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.392062 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.391966 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1234228-0c89-4eaa-8675-9128af02dae8-metrics-server-audit-profiles\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.392062 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.392003 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1234228-0c89-4eaa-8675-9128af02dae8-secret-metrics-server-client-certs\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.392062 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.392032 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1234228-0c89-4eaa-8675-9128af02dae8-audit-log\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.392209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.392066 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9kb6\" (UniqueName: \"kubernetes.io/projected/b1234228-0c89-4eaa-8675-9128af02dae8-kube-api-access-q9kb6\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.392209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.392171 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1234228-0c89-4eaa-8675-9128af02dae8-secret-metrics-server-tls\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.392209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.392198 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1234228-0c89-4eaa-8675-9128af02dae8-client-ca-bundle\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.392612 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.392581 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b1234228-0c89-4eaa-8675-9128af02dae8-audit-log\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.392766 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.392746 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1234228-0c89-4eaa-8675-9128af02dae8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.393211 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.393187 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b1234228-0c89-4eaa-8675-9128af02dae8-metrics-server-audit-profiles\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.394648 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.394623 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b1234228-0c89-4eaa-8675-9128af02dae8-secret-metrics-server-client-certs\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.394764 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.394747 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b1234228-0c89-4eaa-8675-9128af02dae8-secret-metrics-server-tls\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.394914 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.394896 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1234228-0c89-4eaa-8675-9128af02dae8-client-ca-bundle\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.399620 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.399593 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9kb6\" (UniqueName: \"kubernetes.io/projected/b1234228-0c89-4eaa-8675-9128af02dae8-kube-api-access-q9kb6\") pod \"metrics-server-86885df98-szk9w\" (UID: \"b1234228-0c89-4eaa-8675-9128af02dae8\") " pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.498107 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.498028 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:36.624069 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.624035 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-86885df98-szk9w"] Jun 14 03:17:36.626874 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:17:36.626845 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1234228_0c89_4eaa_8675_9128af02dae8.slice/crio-77bf6647fa2efb9f756fc31f17a16cdb7c41198336db21ba2e9ed07f79b2c6ea WatchSource:0}: Error finding container 77bf6647fa2efb9f756fc31f17a16cdb7c41198336db21ba2e9ed07f79b2c6ea: Status 404 returned error can't find the container with id 77bf6647fa2efb9f756fc31f17a16cdb7c41198336db21ba2e9ed07f79b2c6ea Jun 14 03:17:36.657159 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.657136 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:36.674233 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.674207 2547 patch_prober.go:28] interesting pod/image-registry-5f9df476f9-q92df container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 03:17:36.674358 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.674258 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" podUID="2021328c-104b-4369-b6d3-4f9056925bd1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 03:17:36.756446 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.756366 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:36.813046 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:36.813004 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:37.041842 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:37.041747 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:37.049408 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:37.049379 2547 patch_prober.go:28] interesting pod/image-registry-565c584dd-lg8s7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 14 03:17:37.049541 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:37.049433 2547 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-565c584dd-lg8s7" podUID="de8d6d0b-3347-47b6-8bf1-ffe970a48072" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 03:17:37.269739 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:37.269701 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86885df98-szk9w" event={"ID":"b1234228-0c89-4eaa-8675-9128af02dae8","Type":"ContainerStarted","Data":"77bf6647fa2efb9f756fc31f17a16cdb7c41198336db21ba2e9ed07f79b2c6ea"} Jun 14 03:17:38.075361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:38.075332 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:38.274784 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:38.274686 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-86885df98-szk9w" event={"ID":"b1234228-0c89-4eaa-8675-9128af02dae8","Type":"ContainerStarted","Data":"b0e9243ec7183f24878b817498066ae05e26c62889bd4f065ab8486fed75f5ce"} Jun 14 03:17:38.292183 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:38.292137 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-86885df98-szk9w" podStartSLOduration=0.947397768 podStartE2EDuration="2.292119114s" totalImagesPullingTime="1.344721346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:38.290911592 +0000 UTC m=+281.406525792" watchObservedRunningTime="2026-06-14 03:17:38.292119114 +0000 UTC m=+281.407733314" Jun 14 03:17:38.870468 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:17:38.870424 2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pcxsf" podUID="34053198-82d1-4bd6-ac10-c8ba3216c9bb" Jun 14 03:17:39.195432 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:39.195405 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-565c584dd-lg8s7" Jun 14 03:17:39.278659 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:39.278625 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcxsf" Jun 14 03:17:39.313399 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:39.313372 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:40.375224 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:40.375178 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:41.690707 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:41.690645 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" podUID="2021328c-104b-4369-b6d3-4f9056925bd1" containerName="registry" containerID="cri-o://6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03" gracePeriod=30 Jun 14 03:17:41.925735 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:41.925706 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:17:42.039616 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.039521 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-bound-sa-token\") pod \"2021328c-104b-4369-b6d3-4f9056925bd1\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " Jun 14 03:17:42.039616 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.039566 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtspn\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-kube-api-access-mtspn\") pod \"2021328c-104b-4369-b6d3-4f9056925bd1\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " Jun 14 03:17:42.039616 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.039620 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls\") pod \"2021328c-104b-4369-b6d3-4f9056925bd1\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " Jun 14 03:17:42.039923 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.039659 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-trusted-ca\") pod \"2021328c-104b-4369-b6d3-4f9056925bd1\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " Jun 14 03:17:42.039923 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.039681 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-registry-certificates\") pod \"2021328c-104b-4369-b6d3-4f9056925bd1\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " Jun 14 03:17:42.039923 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.039732 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-installation-pull-secrets\") pod \"2021328c-104b-4369-b6d3-4f9056925bd1\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " Jun 14 03:17:42.039923 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.039764 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-image-registry-private-configuration\") pod \"2021328c-104b-4369-b6d3-4f9056925bd1\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " Jun 14 03:17:42.039923 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.039791 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2021328c-104b-4369-b6d3-4f9056925bd1-ca-trust-extracted\") pod \"2021328c-104b-4369-b6d3-4f9056925bd1\" (UID: \"2021328c-104b-4369-b6d3-4f9056925bd1\") " Jun 14 03:17:42.040186 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.040147 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2021328c-104b-4369-b6d3-4f9056925bd1" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:17:42.040498 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.040470 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2021328c-104b-4369-b6d3-4f9056925bd1" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:17:42.042009 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.041980 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2021328c-104b-4369-b6d3-4f9056925bd1" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:17:42.042009 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.042001 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2021328c-104b-4369-b6d3-4f9056925bd1" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:17:42.042152 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.042110 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-kube-api-access-mtspn" (OuterVolumeSpecName: "kube-api-access-mtspn") pod "2021328c-104b-4369-b6d3-4f9056925bd1" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1"). InnerVolumeSpecName "kube-api-access-mtspn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:17:42.042495 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.042472 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2021328c-104b-4369-b6d3-4f9056925bd1" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:17:42.042574 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.042560 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2021328c-104b-4369-b6d3-4f9056925bd1" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:17:42.051398 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.051356 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2021328c-104b-4369-b6d3-4f9056925bd1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2021328c-104b-4369-b6d3-4f9056925bd1" (UID: "2021328c-104b-4369-b6d3-4f9056925bd1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:17:42.140703 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.140650 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-trusted-ca\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:17:42.140703 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.140696 2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2021328c-104b-4369-b6d3-4f9056925bd1-registry-certificates\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:17:42.140703 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.140710 2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-installation-pull-secrets\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:17:42.140976 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.140723 2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2021328c-104b-4369-b6d3-4f9056925bd1-image-registry-private-configuration\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:17:42.140976 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.140737 2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2021328c-104b-4369-b6d3-4f9056925bd1-ca-trust-extracted\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:17:42.140976 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.140748 2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-bound-sa-token\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:17:42.140976 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.140760 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtspn\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-kube-api-access-mtspn\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:17:42.140976 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.140772 2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2021328c-104b-4369-b6d3-4f9056925bd1-registry-tls\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:17:42.241338 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.241300 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:17:42.243642 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.243617 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/34053198-82d1-4bd6-ac10-c8ba3216c9bb-metrics-tls\") pod \"dns-default-pcxsf\" (UID: \"34053198-82d1-4bd6-ac10-c8ba3216c9bb\") " pod="openshift-dns/dns-default-pcxsf" Jun 14 03:17:42.282052 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.282026 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ctq98\"" Jun 14 03:17:42.288987 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.288961 2547 generic.go:356] "Generic (PLEG): container finished" podID="2021328c-104b-4369-b6d3-4f9056925bd1" containerID="6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03" exitCode=0 Jun 14 03:17:42.289094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.288999 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" Jun 14 03:17:42.289094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.289047 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" event={"ID":"2021328c-104b-4369-b6d3-4f9056925bd1","Type":"ContainerDied","Data":"6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03"} Jun 14 03:17:42.289169 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.289096 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f9df476f9-q92df" event={"ID":"2021328c-104b-4369-b6d3-4f9056925bd1","Type":"ContainerDied","Data":"a7702a82643bc6ef47d330af8346c46ed143e32ef84706679a1ea44216a80d2b"} Jun 14 03:17:42.289169 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.289121 2547 scope.go:117] "RemoveContainer" containerID="6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03" Jun 14 03:17:42.289780 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.289733 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pcxsf" Jun 14 03:17:42.299242 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.299222 2547 scope.go:117] "RemoveContainer" containerID="6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03" Jun 14 03:17:42.299490 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:17:42.299470 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03\": container with ID starting with 6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03 not found: ID does not exist" containerID="6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03" Jun 14 03:17:42.299564 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.299512 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03"} err="failed to get container status \"6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03\": rpc error: code = NotFound desc = could not find container \"6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03\": container with ID starting with 6221bc009ab2552a1419892c749e7bff19b2aa308ab8b7074b22ef1bbb1bde03 not found: ID does not exist" Jun 14 03:17:42.309312 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.309286 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f9df476f9-q92df"] Jun 14 03:17:42.312852 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.312829 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f9df476f9-q92df"] Jun 14 03:17:42.417050 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:42.417016 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pcxsf"] Jun 14 03:17:42.419974 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:17:42.419950 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34053198_82d1_4bd6_ac10_c8ba3216c9bb.slice/crio-44765432f836ea366fa045b0ed87d777caee2abea59d0fd1f1016b6714c18034 WatchSource:0}: Error finding container 44765432f836ea366fa045b0ed87d777caee2abea59d0fd1f1016b6714c18034: Status 404 returned error can't find the container with id 44765432f836ea366fa045b0ed87d777caee2abea59d0fd1f1016b6714c18034 Jun 14 03:17:43.295693 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:43.295655 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pcxsf" event={"ID":"34053198-82d1-4bd6-ac10-c8ba3216c9bb","Type":"ContainerStarted","Data":"44765432f836ea366fa045b0ed87d777caee2abea59d0fd1f1016b6714c18034"} Jun 14 03:17:43.340539 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:43.340510 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2021328c-104b-4369-b6d3-4f9056925bd1" path="/var/lib/kubelet/pods/2021328c-104b-4369-b6d3-4f9056925bd1/volumes" Jun 14 03:17:43.694878 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:43.694848 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:43.747141 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:43.747076 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:44.302251 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:44.302218 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pcxsf" event={"ID":"34053198-82d1-4bd6-ac10-c8ba3216c9bb","Type":"ContainerStarted","Data":"b97882d2d119d80710c470be98047bf3a3628e8e22b405b7e98d8fd0b8b5b324"} Jun 14 03:17:45.307392 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:45.307352 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pcxsf" event={"ID":"34053198-82d1-4bd6-ac10-c8ba3216c9bb","Type":"ContainerStarted","Data":"4ede684edae2c7afcb412b9a5f5d7fd579bfa7f973cab77e191ef8bd01eb0c98"} Jun 14 03:17:45.307778 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:45.307456 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pcxsf" Jun 14 03:17:45.323882 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:45.323837 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pcxsf" podStartSLOduration=251.630379051 podStartE2EDuration="4m13.323823166s" totalImagesPullingTime="1.693444115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:17:45.323234063 +0000 UTC m=+288.438848286" watchObservedRunningTime="2026-06-14 03:17:45.323823166 +0000 UTC m=+288.439437413" Jun 14 03:17:48.315759 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.315728 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-mk9zx"] Jun 14 03:17:48.316295 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.315985 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2021328c-104b-4369-b6d3-4f9056925bd1" containerName="registry" Jun 14 03:17:48.316295 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.315996 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2021328c-104b-4369-b6d3-4f9056925bd1" containerName="registry" Jun 14 03:17:48.316295 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.316046 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2021328c-104b-4369-b6d3-4f9056925bd1" containerName="registry" Jun 14 03:17:48.317809 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.317777 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-mk9zx" Jun 14 03:17:48.320571 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.320541 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 03:17:48.320571 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.320548 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 03:17:48.320726 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.320669 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-k7ppz\"" Jun 14 03:17:48.330896 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.330873 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-mk9zx"] Jun 14 03:17:48.338364 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.338341 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:48.395020 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.394990 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svgnv\" (UniqueName: \"kubernetes.io/projected/4927dc0a-630a-4a1f-98e3-1c07deb6addb-kube-api-access-svgnv\") pod \"downloads-694c955b9-mk9zx\" (UID: \"4927dc0a-630a-4a1f-98e3-1c07deb6addb\") " pod="openshift-console/downloads-694c955b9-mk9zx" Jun 14 03:17:48.435926 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.435894 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:48.495382 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.495348 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svgnv\" (UniqueName: \"kubernetes.io/projected/4927dc0a-630a-4a1f-98e3-1c07deb6addb-kube-api-access-svgnv\") pod \"downloads-694c955b9-mk9zx\" (UID: \"4927dc0a-630a-4a1f-98e3-1c07deb6addb\") " pod="openshift-console/downloads-694c955b9-mk9zx" Jun 14 03:17:48.503274 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.503250 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svgnv\" (UniqueName: \"kubernetes.io/projected/4927dc0a-630a-4a1f-98e3-1c07deb6addb-kube-api-access-svgnv\") pod \"downloads-694c955b9-mk9zx\" (UID: \"4927dc0a-630a-4a1f-98e3-1c07deb6addb\") " pod="openshift-console/downloads-694c955b9-mk9zx" Jun 14 03:17:48.535527 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.535495 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:48.626660 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.626564 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-mk9zx" Jun 14 03:17:48.749243 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.749222 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-mk9zx"] Jun 14 03:17:48.751780 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:17:48.751748 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4927dc0a_630a_4a1f_98e3_1c07deb6addb.slice/crio-6fe19db5f379bf76b4a31f9ab5288c4c9097793beca23a78248383cb94f938c4 WatchSource:0}: Error finding container 6fe19db5f379bf76b4a31f9ab5288c4c9097793beca23a78248383cb94f938c4: Status 404 returned error can't find the container with id 6fe19db5f379bf76b4a31f9ab5288c4c9097793beca23a78248383cb94f938c4 Jun 14 03:17:48.805322 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.805292 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:48.862423 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.862387 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:48.991459 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:48.991426 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:49.092917 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:49.092878 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:49.322794 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:49.322701 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-mk9zx" event={"ID":"4927dc0a-630a-4a1f-98e3-1c07deb6addb","Type":"ContainerStarted","Data":"6fe19db5f379bf76b4a31f9ab5288c4c9097793beca23a78248383cb94f938c4"} Jun 14 03:17:50.001943 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:50.001904 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:50.052608 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:50.052561 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:50.204023 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:50.203983 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:50.304889 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:50.304787 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:51.517581 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:51.517544 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:51.618412 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:51.618346 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:54.112699 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:54.112656 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:54.164075 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:54.164044 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:55.313266 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:55.313235 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pcxsf" Jun 14 03:17:56.498892 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:56.498856 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:56.499329 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:56.498925 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:17:57.297061 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:57.297033 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:17:57.297322 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:57.297302 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:17:57.303237 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:57.303208 2547 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 03:17:58.823600 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:58.823565 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:17:58.879732 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:17:58.879698 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:00.587771 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:00.587731 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:00.688246 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:00.688194 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:04.381882 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:04.381858 2547 generic.go:356] "Generic (PLEG): container finished" podID="34dd0143-39a2-425e-a2bf-d44443809763" containerID="eb36d5954b8b55e88c7b82215e354f13142455e51dc8f91d57afb5d9edbc9f62" exitCode=0 Jun 14 03:18:04.382247 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:04.381927 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" event={"ID":"34dd0143-39a2-425e-a2bf-d44443809763","Type":"ContainerDied","Data":"eb36d5954b8b55e88c7b82215e354f13142455e51dc8f91d57afb5d9edbc9f62"} Jun 14 03:18:04.382321 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:04.382255 2547 scope.go:117] "RemoveContainer" containerID="eb36d5954b8b55e88c7b82215e354f13142455e51dc8f91d57afb5d9edbc9f62" Jun 14 03:18:04.383585 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:04.383478 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-mk9zx" event={"ID":"4927dc0a-630a-4a1f-98e3-1c07deb6addb","Type":"ContainerStarted","Data":"ae3d1774dac527639ce7202f60f73e69ebbd43f5eee7f6072732043344ef3171"} Jun 14 03:18:04.383736 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:04.383720 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-mk9zx" Jun 14 03:18:04.385253 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:04.385228 2547 patch_prober.go:28] interesting pod/downloads-694c955b9-mk9zx container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" start-of-body= Jun 14 03:18:04.385335 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:04.385276 2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-694c955b9-mk9zx" podUID="4927dc0a-630a-4a1f-98e3-1c07deb6addb" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" Jun 14 03:18:04.417505 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:04.417460 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-mk9zx" podStartSLOduration=0.847988126 podStartE2EDuration="16.417442301s" totalImagesPullingTime="15.569454175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:18:04.41619743 +0000 UTC m=+307.531811631" watchObservedRunningTime="2026-06-14 03:18:04.417442301 +0000 UTC m=+307.533056504" Jun 14 03:18:04.439647 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:04.439626 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:05.390573 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:05.390530 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-2b46w" event={"ID":"34dd0143-39a2-425e-a2bf-d44443809763","Type":"ContainerStarted","Data":"6a9484d4f7c816760c1307436f3a6dc3e2a0b231b77da83bb1fad21e7b318c04"} Jun 14 03:18:05.402072 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:05.402043 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-mk9zx" Jun 14 03:18:06.219681 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.219644 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6559d486d-htfzj"] Jun 14 03:18:06.225071 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.225041 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.227628 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.227602 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 03:18:06.228662 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.228639 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8qxtj\"" Jun 14 03:18:06.228766 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.228668 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 03:18:06.228766 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.228696 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 03:18:06.228910 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.228833 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 03:18:06.228910 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.228859 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 03:18:06.233194 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.233171 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 03:18:06.234953 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.234924 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6559d486d-htfzj"] Jun 14 03:18:06.249082 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.248686 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-trusted-ca-bundle\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.249082 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.248723 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-service-ca\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.249082 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.248757 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-oauth-serving-cert\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.249082 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.248823 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-oauth-config\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.249082 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.248926 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-serving-cert\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.249082 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.248960 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mljsh\" (UniqueName: \"kubernetes.io/projected/86f44beb-a81d-414c-bdcc-b1569f440c96-kube-api-access-mljsh\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.249082 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.248994 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-console-config\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.349822 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.349755 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-oauth-config\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.350024 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.349888 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-serving-cert\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.350024 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.349928 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mljsh\" (UniqueName: \"kubernetes.io/projected/86f44beb-a81d-414c-bdcc-b1569f440c96-kube-api-access-mljsh\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.350024 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.349962 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-console-config\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.350024 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.349992 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-trusted-ca-bundle\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.350024 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.350017 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-service-ca\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.350335 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.350049 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-oauth-serving-cert\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.350843 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.350795 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-console-config\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.350983 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.350819 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-oauth-serving-cert\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.350983 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.350970 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-trusted-ca-bundle\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.351119 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.351014 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-service-ca\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.352899 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.352866 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-serving-cert\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.353238 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.353217 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-oauth-config\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.358251 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.358230 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mljsh\" (UniqueName: \"kubernetes.io/projected/86f44beb-a81d-414c-bdcc-b1569f440c96-kube-api-access-mljsh\") pod \"console-6559d486d-htfzj\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.538166 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.538081 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:06.711150 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.711111 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6559d486d-htfzj"] Jun 14 03:18:06.714339 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:18:06.714298 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f44beb_a81d_414c_bdcc_b1569f440c96.slice/crio-e07ae88ef1be8a3a5deef0690ac309ebb18c589da5aab28a49afbd37c55faf18 WatchSource:0}: Error finding container e07ae88ef1be8a3a5deef0690ac309ebb18c589da5aab28a49afbd37c55faf18: Status 404 returned error can't find the container with id e07ae88ef1be8a3a5deef0690ac309ebb18c589da5aab28a49afbd37c55faf18 Jun 14 03:18:06.716504 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:06.716484 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 03:18:07.401071 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:07.401018 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6559d486d-htfzj" event={"ID":"86f44beb-a81d-414c-bdcc-b1569f440c96","Type":"ContainerStarted","Data":"e07ae88ef1be8a3a5deef0690ac309ebb18c589da5aab28a49afbd37c55faf18"} Jun 14 03:18:07.614162 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:07.614126 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:07.670851 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:07.670815 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:08.627307 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:08.627103 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:08.727982 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:08.727881 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:09.822566 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:09.822527 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:09.923728 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:09.923693 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:10.418014 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:10.417975 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6559d486d-htfzj" event={"ID":"86f44beb-a81d-414c-bdcc-b1569f440c96","Type":"ContainerStarted","Data":"be75f658612be09caa0350ffb3ec55f832f817831f301fa5cd51852bc3d4fd61"} Jun 14 03:18:15.438994 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:15.438960 2547 generic.go:356] "Generic (PLEG): container finished" podID="4dd7804f-6835-4629-b817-f441cb2ac2ae" containerID="ebca5ac8b341b68b1f243f369d0a711243378ca99774fb86363f3a1b1e5e5b1e" exitCode=0 Jun 14 03:18:15.439421 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:15.439042 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" event={"ID":"4dd7804f-6835-4629-b817-f441cb2ac2ae","Type":"ContainerDied","Data":"ebca5ac8b341b68b1f243f369d0a711243378ca99774fb86363f3a1b1e5e5b1e"} Jun 14 03:18:15.439421 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:15.439362 2547 scope.go:117] "RemoveContainer" containerID="ebca5ac8b341b68b1f243f369d0a711243378ca99774fb86363f3a1b1e5e5b1e" Jun 14 03:18:15.455574 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:15.455530 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6559d486d-htfzj" podStartSLOduration=5.91166753 podStartE2EDuration="9.455511777s" totalImagesPullingTime="3.543844247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:18:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:18:10.436093668 +0000 UTC m=+313.551707906" watchObservedRunningTime="2026-06-14 03:18:15.455511777 +0000 UTC m=+318.571125977" Jun 14 03:18:16.359913 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:16.359873 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:16.417414 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:16.417379 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:16.444815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:16.444772 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-5zppm" event={"ID":"4dd7804f-6835-4629-b817-f441cb2ac2ae","Type":"ContainerStarted","Data":"c7bd60ca234f3ae554dd4e10ea07eb51d1d190784bc97fa7adaaba73e9baf171"} Jun 14 03:18:16.503881 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:16.503851 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:18:16.507919 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:16.507890 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-86885df98-szk9w" Jun 14 03:18:16.538487 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:16.538453 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:16.538669 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:16.538504 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:16.543191 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:16.543170 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:17.452491 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:17.452462 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:18:17.639024 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:17.638984 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:17.739452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:17.739345 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:17.792179 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:17.792150 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:19.457852 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:19.457791 2547 generic.go:356] "Generic (PLEG): container finished" podID="988f4a36-8720-400e-b3f8-d0d879d82c85" containerID="cde37379d9422dcbd2e7d2d27062a64bdb7e0a9ed6f52bbb287f41daf9781c7b" exitCode=0 Jun 14 03:18:19.458270 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:19.457865 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" event={"ID":"988f4a36-8720-400e-b3f8-d0d879d82c85","Type":"ContainerDied","Data":"cde37379d9422dcbd2e7d2d27062a64bdb7e0a9ed6f52bbb287f41daf9781c7b"} Jun 14 03:18:19.458270 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:19.458208 2547 scope.go:117] "RemoveContainer" containerID="cde37379d9422dcbd2e7d2d27062a64bdb7e0a9ed6f52bbb287f41daf9781c7b" Jun 14 03:18:20.463123 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:20.463090 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-f8ptq" event={"ID":"988f4a36-8720-400e-b3f8-d0d879d82c85","Type":"ContainerStarted","Data":"c7acc99ac5bbb2a8a932dfb372111bfeb8b79040a2d2d127a3d2344ab0a49228"} Jun 14 03:18:22.619188 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:22.619156 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:22.716483 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:22.716450 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:42.400625 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:42.400589 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:47.938655 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:47.938573 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:48.038915 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:48.038882 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:48.582384 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:48.582347 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:48.636097 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:48.636064 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:48.719475 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:48.719442 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:48.772536 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:48.772508 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:49.338197 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:49.338165 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:49.403816 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:49.403780 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:53.070043 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:53.070010 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:53.155640 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:53.155611 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:59.528344 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:59.528311 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6559d486d-htfzj"] Jun 14 03:18:59.628388 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:59.628359 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:59.684821 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:59.684776 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:59.750598 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:59.750567 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:59.892872 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:59.892768 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:18:59.947454 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:18:59.947420 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:19:07.621692 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:07.621657 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:19:07.722867 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:07.722829 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:19:13.526965 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:13.526931 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:19:24.548416 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.548364 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6559d486d-htfzj" podUID="86f44beb-a81d-414c-bdcc-b1569f440c96" containerName="console" containerID="cri-o://be75f658612be09caa0350ffb3ec55f832f817831f301fa5cd51852bc3d4fd61" gracePeriod=15 Jun 14 03:19:24.704108 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.704075 2547 generic.go:356] "Generic (PLEG): container finished" podID="86f44beb-a81d-414c-bdcc-b1569f440c96" containerID="be75f658612be09caa0350ffb3ec55f832f817831f301fa5cd51852bc3d4fd61" exitCode=0 Jun 14 03:19:24.704260 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.704155 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6559d486d-htfzj" event={"ID":"86f44beb-a81d-414c-bdcc-b1569f440c96","Type":"ContainerDied","Data":"be75f658612be09caa0350ffb3ec55f832f817831f301fa5cd51852bc3d4fd61"} Jun 14 03:19:24.788948 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.788926 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:19:24.912049 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912017 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-console-config\") pod \"86f44beb-a81d-414c-bdcc-b1569f440c96\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " Jun 14 03:19:24.912248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912081 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-oauth-config\") pod \"86f44beb-a81d-414c-bdcc-b1569f440c96\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " Jun 14 03:19:24.912248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912115 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-service-ca\") pod \"86f44beb-a81d-414c-bdcc-b1569f440c96\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " Jun 14 03:19:24.912248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912177 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-serving-cert\") pod \"86f44beb-a81d-414c-bdcc-b1569f440c96\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " Jun 14 03:19:24.912248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912215 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-trusted-ca-bundle\") pod \"86f44beb-a81d-414c-bdcc-b1569f440c96\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " Jun 14 03:19:24.912248 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912238 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-oauth-serving-cert\") pod \"86f44beb-a81d-414c-bdcc-b1569f440c96\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " Jun 14 03:19:24.912486 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912263 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mljsh\" (UniqueName: \"kubernetes.io/projected/86f44beb-a81d-414c-bdcc-b1569f440c96-kube-api-access-mljsh\") pod \"86f44beb-a81d-414c-bdcc-b1569f440c96\" (UID: \"86f44beb-a81d-414c-bdcc-b1569f440c96\") " Jun 14 03:19:24.912533 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912510 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-console-config" (OuterVolumeSpecName: "console-config") pod "86f44beb-a81d-414c-bdcc-b1569f440c96" (UID: "86f44beb-a81d-414c-bdcc-b1569f440c96"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:19:24.912588 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912547 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-service-ca" (OuterVolumeSpecName: "service-ca") pod "86f44beb-a81d-414c-bdcc-b1569f440c96" (UID: "86f44beb-a81d-414c-bdcc-b1569f440c96"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:19:24.912694 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912659 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "86f44beb-a81d-414c-bdcc-b1569f440c96" (UID: "86f44beb-a81d-414c-bdcc-b1569f440c96"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:19:24.912959 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.912916 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "86f44beb-a81d-414c-bdcc-b1569f440c96" (UID: "86f44beb-a81d-414c-bdcc-b1569f440c96"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 03:19:24.914509 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.914478 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86f44beb-a81d-414c-bdcc-b1569f440c96-kube-api-access-mljsh" (OuterVolumeSpecName: "kube-api-access-mljsh") pod "86f44beb-a81d-414c-bdcc-b1569f440c96" (UID: "86f44beb-a81d-414c-bdcc-b1569f440c96"). InnerVolumeSpecName "kube-api-access-mljsh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:19:24.914597 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.914518 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "86f44beb-a81d-414c-bdcc-b1569f440c96" (UID: "86f44beb-a81d-414c-bdcc-b1569f440c96"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:19:24.914597 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:24.914529 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "86f44beb-a81d-414c-bdcc-b1569f440c96" (UID: "86f44beb-a81d-414c-bdcc-b1569f440c96"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:19:25.013119 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.013078 2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-trusted-ca-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:19:25.013119 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.013111 2547 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-oauth-serving-cert\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:19:25.013119 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.013121 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mljsh\" (UniqueName: \"kubernetes.io/projected/86f44beb-a81d-414c-bdcc-b1569f440c96-kube-api-access-mljsh\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:19:25.013351 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.013137 2547 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-console-config\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:19:25.013351 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.013146 2547 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-oauth-config\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:19:25.013351 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.013155 2547 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86f44beb-a81d-414c-bdcc-b1569f440c96-service-ca\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:19:25.013351 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.013163 2547 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86f44beb-a81d-414c-bdcc-b1569f440c96-console-serving-cert\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:19:25.709352 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.709312 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6559d486d-htfzj" event={"ID":"86f44beb-a81d-414c-bdcc-b1569f440c96","Type":"ContainerDied","Data":"e07ae88ef1be8a3a5deef0690ac309ebb18c589da5aab28a49afbd37c55faf18"} Jun 14 03:19:25.709352 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.709329 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6559d486d-htfzj" Jun 14 03:19:25.709942 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.709372 2547 scope.go:117] "RemoveContainer" containerID="be75f658612be09caa0350ffb3ec55f832f817831f301fa5cd51852bc3d4fd61" Jun 14 03:19:25.724943 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.724919 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6559d486d-htfzj"] Jun 14 03:19:25.728329 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:25.728305 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6559d486d-htfzj"] Jun 14 03:19:27.338499 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:27.338453 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86f44beb-a81d-414c-bdcc-b1569f440c96" path="/var/lib/kubelet/pods/86f44beb-a81d-414c-bdcc-b1569f440c96/volumes" Jun 14 03:19:50.344020 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:50.343979 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:19:50.397031 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:50.397000 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:19:50.698460 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:50.698427 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:19:50.796192 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:50.796156 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:19:51.229179 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.229150 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h"] Jun 14 03:19:51.229421 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.229409 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86f44beb-a81d-414c-bdcc-b1569f440c96" containerName="console" Jun 14 03:19:51.229463 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.229422 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="86f44beb-a81d-414c-bdcc-b1569f440c96" containerName="console" Jun 14 03:19:51.229504 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.229473 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="86f44beb-a81d-414c-bdcc-b1569f440c96" containerName="console" Jun 14 03:19:51.231398 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.231379 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.234882 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.234847 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nsh4l\"" Jun 14 03:19:51.238540 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.235198 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 03:19:51.238634 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.235253 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 03:19:51.241662 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.241640 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h"] Jun 14 03:19:51.422404 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.422366 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.422790 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.422415 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjm62\" (UniqueName: \"kubernetes.io/projected/551e6c6b-1180-441d-a1fb-d76d4a062bdf-kube-api-access-mjm62\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.422790 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.422517 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.523558 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.523461 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.523558 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.523514 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.523558 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.523546 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjm62\" (UniqueName: \"kubernetes.io/projected/551e6c6b-1180-441d-a1fb-d76d4a062bdf-kube-api-access-mjm62\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.523955 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.523934 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.524005 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.523989 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.531758 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.531731 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjm62\" (UniqueName: \"kubernetes.io/projected/551e6c6b-1180-441d-a1fb-d76d4a062bdf-kube-api-access-mjm62\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.544746 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.544727 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:19:51.673492 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.673466 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h"] Jun 14 03:19:51.675910 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:19:51.675881 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551e6c6b_1180_441d_a1fb_d76d4a062bdf.slice/crio-73bdf95396067172b1e39e40d31a92009a9affaaa09579a225ee9607906f792d WatchSource:0}: Error finding container 73bdf95396067172b1e39e40d31a92009a9affaaa09579a225ee9607906f792d: Status 404 returned error can't find the container with id 73bdf95396067172b1e39e40d31a92009a9affaaa09579a225ee9607906f792d Jun 14 03:19:51.806156 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:51.806064 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" event={"ID":"551e6c6b-1180-441d-a1fb-d76d4a062bdf","Type":"ContainerStarted","Data":"73bdf95396067172b1e39e40d31a92009a9affaaa09579a225ee9607906f792d"} Jun 14 03:19:57.831008 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:57.830975 2547 generic.go:356] "Generic (PLEG): container finished" podID="551e6c6b-1180-441d-a1fb-d76d4a062bdf" containerID="89e3f10cc5809d5745d535216096c2365947a04f861160846960460b332d556a" exitCode=0 Jun 14 03:19:57.831403 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:57.831063 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" event={"ID":"551e6c6b-1180-441d-a1fb-d76d4a062bdf","Type":"ContainerDied","Data":"89e3f10cc5809d5745d535216096c2365947a04f861160846960460b332d556a"} Jun 14 03:19:59.840504 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:59.840473 2547 generic.go:356] "Generic (PLEG): container finished" podID="551e6c6b-1180-441d-a1fb-d76d4a062bdf" containerID="990ca34c3a3daa50601fa962449a62b15ce06a1cd199eeda70627f9d7b5eb059" exitCode=0 Jun 14 03:19:59.840946 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:19:59.840534 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" event={"ID":"551e6c6b-1180-441d-a1fb-d76d4a062bdf","Type":"ContainerDied","Data":"990ca34c3a3daa50601fa962449a62b15ce06a1cd199eeda70627f9d7b5eb059"} Jun 14 03:20:06.872000 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:06.871913 2547 generic.go:356] "Generic (PLEG): container finished" podID="551e6c6b-1180-441d-a1fb-d76d4a062bdf" containerID="0d221205eddb20b47c9e84666b53246999c52dffa896cc9e953b8714550de0a6" exitCode=0 Jun 14 03:20:06.872000 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:06.871986 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" event={"ID":"551e6c6b-1180-441d-a1fb-d76d4a062bdf","Type":"ContainerDied","Data":"0d221205eddb20b47c9e84666b53246999c52dffa896cc9e953b8714550de0a6"} Jun 14 03:20:07.997109 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:07.997084 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:20:08.059581 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.059545 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjm62\" (UniqueName: \"kubernetes.io/projected/551e6c6b-1180-441d-a1fb-d76d4a062bdf-kube-api-access-mjm62\") pod \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " Jun 14 03:20:08.059763 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.059626 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-util\") pod \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " Jun 14 03:20:08.059763 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.059646 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-bundle\") pod \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\" (UID: \"551e6c6b-1180-441d-a1fb-d76d4a062bdf\") " Jun 14 03:20:08.060319 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.060294 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-bundle" (OuterVolumeSpecName: "bundle") pod "551e6c6b-1180-441d-a1fb-d76d4a062bdf" (UID: "551e6c6b-1180-441d-a1fb-d76d4a062bdf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:20:08.061759 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.061735 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/551e6c6b-1180-441d-a1fb-d76d4a062bdf-kube-api-access-mjm62" (OuterVolumeSpecName: "kube-api-access-mjm62") pod "551e6c6b-1180-441d-a1fb-d76d4a062bdf" (UID: "551e6c6b-1180-441d-a1fb-d76d4a062bdf"). InnerVolumeSpecName "kube-api-access-mjm62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:20:08.063768 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.063742 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-util" (OuterVolumeSpecName: "util") pod "551e6c6b-1180-441d-a1fb-d76d4a062bdf" (UID: "551e6c6b-1180-441d-a1fb-d76d4a062bdf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:20:08.160810 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.160776 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-util\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:20:08.160961 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.160828 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/551e6c6b-1180-441d-a1fb-d76d4a062bdf-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:20:08.160961 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.160838 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjm62\" (UniqueName: \"kubernetes.io/projected/551e6c6b-1180-441d-a1fb-d76d4a062bdf-kube-api-access-mjm62\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:20:08.880609 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.880583 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" Jun 14 03:20:08.880744 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.880582 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dcpb5h" event={"ID":"551e6c6b-1180-441d-a1fb-d76d4a062bdf","Type":"ContainerDied","Data":"73bdf95396067172b1e39e40d31a92009a9affaaa09579a225ee9607906f792d"} Jun 14 03:20:08.880744 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:08.880696 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73bdf95396067172b1e39e40d31a92009a9affaaa09579a225ee9607906f792d" Jun 14 03:20:12.187892 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:12.187855 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:13.009389 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:13.009349 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:14.123149 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.123116 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn"] Jun 14 03:20:14.123534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.123394 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551e6c6b-1180-441d-a1fb-d76d4a062bdf" containerName="extract" Jun 14 03:20:14.123534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.123407 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="551e6c6b-1180-441d-a1fb-d76d4a062bdf" containerName="extract" Jun 14 03:20:14.123534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.123436 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551e6c6b-1180-441d-a1fb-d76d4a062bdf" containerName="util" Jun 14 03:20:14.123534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.123442 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="551e6c6b-1180-441d-a1fb-d76d4a062bdf" containerName="util" Jun 14 03:20:14.123534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.123454 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="551e6c6b-1180-441d-a1fb-d76d4a062bdf" containerName="pull" Jun 14 03:20:14.123534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.123460 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="551e6c6b-1180-441d-a1fb-d76d4a062bdf" containerName="pull" Jun 14 03:20:14.123534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.123517 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="551e6c6b-1180-441d-a1fb-d76d4a062bdf" containerName="extract" Jun 14 03:20:14.173980 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.173946 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn"] Jun 14 03:20:14.174125 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.174047 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" Jun 14 03:20:14.176497 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.176469 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jcsvp\"" Jun 14 03:20:14.176497 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.176490 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 14 03:20:14.176670 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.176472 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 14 03:20:14.208175 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.208142 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jbfq\" (UniqueName: \"kubernetes.io/projected/36b4f702-3dcd-48f1-bb2b-1bd419291762-kube-api-access-6jbfq\") pod \"cert-manager-operator-controller-manager-57757f7cfc-tvfcn\" (UID: \"36b4f702-3dcd-48f1-bb2b-1bd419291762\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" Jun 14 03:20:14.208328 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.208195 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36b4f702-3dcd-48f1-bb2b-1bd419291762-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-tvfcn\" (UID: \"36b4f702-3dcd-48f1-bb2b-1bd419291762\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" Jun 14 03:20:14.308790 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.308749 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jbfq\" (UniqueName: \"kubernetes.io/projected/36b4f702-3dcd-48f1-bb2b-1bd419291762-kube-api-access-6jbfq\") pod \"cert-manager-operator-controller-manager-57757f7cfc-tvfcn\" (UID: \"36b4f702-3dcd-48f1-bb2b-1bd419291762\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" Jun 14 03:20:14.308980 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.308838 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36b4f702-3dcd-48f1-bb2b-1bd419291762-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-tvfcn\" (UID: \"36b4f702-3dcd-48f1-bb2b-1bd419291762\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" Jun 14 03:20:14.309171 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.309157 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36b4f702-3dcd-48f1-bb2b-1bd419291762-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-tvfcn\" (UID: \"36b4f702-3dcd-48f1-bb2b-1bd419291762\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" Jun 14 03:20:14.317203 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.317175 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jbfq\" (UniqueName: \"kubernetes.io/projected/36b4f702-3dcd-48f1-bb2b-1bd419291762-kube-api-access-6jbfq\") pod \"cert-manager-operator-controller-manager-57757f7cfc-tvfcn\" (UID: \"36b4f702-3dcd-48f1-bb2b-1bd419291762\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" Jun 14 03:20:14.482997 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.482963 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" Jun 14 03:20:14.635267 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.635231 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn"] Jun 14 03:20:14.640061 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:20:14.640035 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b4f702_3dcd_48f1_bb2b_1bd419291762.slice/crio-3120e02eff5be17dc08adc8398be2afdc53b61a6f916881bdc3308d594a8019c WatchSource:0}: Error finding container 3120e02eff5be17dc08adc8398be2afdc53b61a6f916881bdc3308d594a8019c: Status 404 returned error can't find the container with id 3120e02eff5be17dc08adc8398be2afdc53b61a6f916881bdc3308d594a8019c Jun 14 03:20:14.903486 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:14.903453 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" event={"ID":"36b4f702-3dcd-48f1-bb2b-1bd419291762","Type":"ContainerStarted","Data":"3120e02eff5be17dc08adc8398be2afdc53b61a6f916881bdc3308d594a8019c"} Jun 14 03:20:15.791788 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:15.791758 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:15.892200 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:15.892168 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:16.916040 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:16.916003 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" event={"ID":"36b4f702-3dcd-48f1-bb2b-1bd419291762","Type":"ContainerStarted","Data":"780e25b1438c642fe09765176669bac6479ed6c830bbf87a943536d614d7c893"} Jun 14 03:20:16.936641 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:16.936593 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-tvfcn" podStartSLOduration=0.848227007 podStartE2EDuration="2.936579194s" totalImagesPullingTime="2.088352187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:20:16.934090854 +0000 UTC m=+440.049705052" watchObservedRunningTime="2026-06-14 03:20:16.936579194 +0000 UTC m=+440.052193392" Jun 14 03:20:17.369576 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.369543 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:17.462060 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.462019 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:17.715178 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.715144 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:17.824395 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.824361 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:17.880556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.880521 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b"] Jun 14 03:20:17.889753 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.889729 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:17.893821 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.893776 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 03:20:17.894202 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.894185 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nsh4l\"" Jun 14 03:20:17.894674 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.894654 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 03:20:17.899654 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.899627 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b"] Jun 14 03:20:17.935109 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.935072 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:17.935464 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.935127 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2kj5\" (UniqueName: \"kubernetes.io/projected/aaf2f691-5c62-45ee-b995-d87b5942df34-kube-api-access-p2kj5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:17.935464 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:17.935154 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:18.036621 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.036533 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:18.036621 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.036602 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2kj5\" (UniqueName: \"kubernetes.io/projected/aaf2f691-5c62-45ee-b995-d87b5942df34-kube-api-access-p2kj5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:18.036880 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.036640 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:18.037039 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.037011 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:18.037106 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.037020 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:18.044311 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.044288 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2kj5\" (UniqueName: \"kubernetes.io/projected/aaf2f691-5c62-45ee-b995-d87b5942df34-kube-api-access-p2kj5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:18.199107 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.199072 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:18.348409 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.348376 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b"] Jun 14 03:20:18.351743 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:20:18.351714 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf2f691_5c62_45ee_b995_d87b5942df34.slice/crio-774125c69a93f68db869fbfeb196d83d04614c9a878f6220b3d63f0e46bdde1e WatchSource:0}: Error finding container 774125c69a93f68db869fbfeb196d83d04614c9a878f6220b3d63f0e46bdde1e: Status 404 returned error can't find the container with id 774125c69a93f68db869fbfeb196d83d04614c9a878f6220b3d63f0e46bdde1e Jun 14 03:20:18.925642 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.925608 2547 generic.go:356] "Generic (PLEG): container finished" podID="aaf2f691-5c62-45ee-b995-d87b5942df34" containerID="eacdc19eafd95f2614416cba81a3b240cc7b826ebac349368906114f4a487fa3" exitCode=0 Jun 14 03:20:18.925856 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.925693 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" event={"ID":"aaf2f691-5c62-45ee-b995-d87b5942df34","Type":"ContainerDied","Data":"eacdc19eafd95f2614416cba81a3b240cc7b826ebac349368906114f4a487fa3"} Jun 14 03:20:18.925856 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:18.925742 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" event={"ID":"aaf2f691-5c62-45ee-b995-d87b5942df34","Type":"ContainerStarted","Data":"774125c69a93f68db869fbfeb196d83d04614c9a878f6220b3d63f0e46bdde1e"} Jun 14 03:20:19.379265 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.379188 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-gf57l"] Jun 14 03:20:19.381695 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.381680 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" Jun 14 03:20:19.384234 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.384207 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 03:20:19.384368 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.384256 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 03:20:19.384368 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.384300 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jmdvp\"" Jun 14 03:20:19.390751 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.390727 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-gf57l"] Jun 14 03:20:19.447264 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.447227 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afc957a1-34be-498d-9da8-f63596c9397d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-gf57l\" (UID: \"afc957a1-34be-498d-9da8-f63596c9397d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" Jun 14 03:20:19.447437 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.447277 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx9dg\" (UniqueName: \"kubernetes.io/projected/afc957a1-34be-498d-9da8-f63596c9397d-kube-api-access-fx9dg\") pod \"cert-manager-webhook-7dc76cbb94-gf57l\" (UID: \"afc957a1-34be-498d-9da8-f63596c9397d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" Jun 14 03:20:19.548275 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.548243 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afc957a1-34be-498d-9da8-f63596c9397d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-gf57l\" (UID: \"afc957a1-34be-498d-9da8-f63596c9397d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" Jun 14 03:20:19.548451 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.548290 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx9dg\" (UniqueName: \"kubernetes.io/projected/afc957a1-34be-498d-9da8-f63596c9397d-kube-api-access-fx9dg\") pod \"cert-manager-webhook-7dc76cbb94-gf57l\" (UID: \"afc957a1-34be-498d-9da8-f63596c9397d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" Jun 14 03:20:19.557351 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.557310 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/afc957a1-34be-498d-9da8-f63596c9397d-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-gf57l\" (UID: \"afc957a1-34be-498d-9da8-f63596c9397d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" Jun 14 03:20:19.557504 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.557407 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx9dg\" (UniqueName: \"kubernetes.io/projected/afc957a1-34be-498d-9da8-f63596c9397d-kube-api-access-fx9dg\") pod \"cert-manager-webhook-7dc76cbb94-gf57l\" (UID: \"afc957a1-34be-498d-9da8-f63596c9397d\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" Jun 14 03:20:19.685138 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.685095 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:19.691983 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.691947 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" Jun 14 03:20:19.744046 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.744007 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:19.845572 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.845540 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-gf57l"] Jun 14 03:20:19.848897 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:20:19.848860 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafc957a1_34be_498d_9da8_f63596c9397d.slice/crio-bbcb985780206db4d3e2b23289f84730540f09496058b8689d53a4185004936d WatchSource:0}: Error finding container bbcb985780206db4d3e2b23289f84730540f09496058b8689d53a4185004936d: Status 404 returned error can't find the container with id bbcb985780206db4d3e2b23289f84730540f09496058b8689d53a4185004936d Jun 14 03:20:19.938832 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:19.938722 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" event={"ID":"afc957a1-34be-498d-9da8-f63596c9397d","Type":"ContainerStarted","Data":"bbcb985780206db4d3e2b23289f84730540f09496058b8689d53a4185004936d"} Jun 14 03:20:21.427682 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:21.427644 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:21.628983 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:21.628948 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:21.954518 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:21.954475 2547 generic.go:356] "Generic (PLEG): container finished" podID="aaf2f691-5c62-45ee-b995-d87b5942df34" containerID="2cb48d9a71687acc0ef0247c568503f2dafb94f1091ad4fb0cfebe8f1a393b04" exitCode=0 Jun 14 03:20:21.954711 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:21.954558 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" event={"ID":"aaf2f691-5c62-45ee-b995-d87b5942df34","Type":"ContainerDied","Data":"2cb48d9a71687acc0ef0247c568503f2dafb94f1091ad4fb0cfebe8f1a393b04"} Jun 14 03:20:22.589165 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:22.589135 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:22.690706 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:22.690663 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:22.960670 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:22.960631 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" event={"ID":"afc957a1-34be-498d-9da8-f63596c9397d","Type":"ContainerStarted","Data":"77624febc923f56a696c8254810944952bbc285bb3c4b62f815aad994080c552"} Jun 14 03:20:22.960885 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:22.960686 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" Jun 14 03:20:22.962733 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:22.962709 2547 generic.go:356] "Generic (PLEG): container finished" podID="aaf2f691-5c62-45ee-b995-d87b5942df34" containerID="3f8e93126f5ca9c619dc5648ce9eacacaeada426a47351a6a90b9f4a40e894bf" exitCode=0 Jun 14 03:20:22.962834 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:22.962770 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" event={"ID":"aaf2f691-5c62-45ee-b995-d87b5942df34","Type":"ContainerDied","Data":"3f8e93126f5ca9c619dc5648ce9eacacaeada426a47351a6a90b9f4a40e894bf"} Jun 14 03:20:22.977963 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:22.977909 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" podStartSLOduration=1.082405408 podStartE2EDuration="3.977894898s" totalImagesPullingTime="2.89548949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:20:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:20:22.976505428 +0000 UTC m=+446.092119629" watchObservedRunningTime="2026-06-14 03:20:22.977894898 +0000 UTC m=+446.093509096" Jun 14 03:20:24.112091 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.112064 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:24.193812 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.193777 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-util\") pod \"aaf2f691-5c62-45ee-b995-d87b5942df34\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " Jun 14 03:20:24.194015 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.193830 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-bundle\") pod \"aaf2f691-5c62-45ee-b995-d87b5942df34\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " Jun 14 03:20:24.194015 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.193874 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2kj5\" (UniqueName: \"kubernetes.io/projected/aaf2f691-5c62-45ee-b995-d87b5942df34-kube-api-access-p2kj5\") pod \"aaf2f691-5c62-45ee-b995-d87b5942df34\" (UID: \"aaf2f691-5c62-45ee-b995-d87b5942df34\") " Jun 14 03:20:24.194288 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.194261 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-bundle" (OuterVolumeSpecName: "bundle") pod "aaf2f691-5c62-45ee-b995-d87b5942df34" (UID: "aaf2f691-5c62-45ee-b995-d87b5942df34"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:20:24.195975 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.195950 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf2f691-5c62-45ee-b995-d87b5942df34-kube-api-access-p2kj5" (OuterVolumeSpecName: "kube-api-access-p2kj5") pod "aaf2f691-5c62-45ee-b995-d87b5942df34" (UID: "aaf2f691-5c62-45ee-b995-d87b5942df34"). InnerVolumeSpecName "kube-api-access-p2kj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:20:24.199032 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.199009 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-util" (OuterVolumeSpecName: "util") pod "aaf2f691-5c62-45ee-b995-d87b5942df34" (UID: "aaf2f691-5c62-45ee-b995-d87b5942df34"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:20:24.295018 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.294932 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-util\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:20:24.295018 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.294963 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aaf2f691-5c62-45ee-b995-d87b5942df34-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:20:24.295018 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.294973 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2kj5\" (UniqueName: \"kubernetes.io/projected/aaf2f691-5c62-45ee-b995-d87b5942df34-kube-api-access-p2kj5\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:20:24.972794 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.972767 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" Jun 14 03:20:24.972794 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.972775 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcnt9b" event={"ID":"aaf2f691-5c62-45ee-b995-d87b5942df34","Type":"ContainerDied","Data":"774125c69a93f68db869fbfeb196d83d04614c9a878f6220b3d63f0e46bdde1e"} Jun 14 03:20:24.973025 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:24.972838 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="774125c69a93f68db869fbfeb196d83d04614c9a878f6220b3d63f0e46bdde1e" Jun 14 03:20:28.814644 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:28.814608 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:28.969776 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:28.969744 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-gf57l" Jun 14 03:20:30.070283 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.070250 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:30.166797 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.166763 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:30.794669 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.794630 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz"] Jun 14 03:20:30.794964 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.794948 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf2f691-5c62-45ee-b995-d87b5942df34" containerName="util" Jun 14 03:20:30.795006 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.794966 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf2f691-5c62-45ee-b995-d87b5942df34" containerName="util" Jun 14 03:20:30.795006 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.794977 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf2f691-5c62-45ee-b995-d87b5942df34" containerName="extract" Jun 14 03:20:30.795006 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.794982 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf2f691-5c62-45ee-b995-d87b5942df34" containerName="extract" Jun 14 03:20:30.795006 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.794992 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf2f691-5c62-45ee-b995-d87b5942df34" containerName="pull" Jun 14 03:20:30.795006 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.794998 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf2f691-5c62-45ee-b995-d87b5942df34" containerName="pull" Jun 14 03:20:30.795159 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.795048 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf2f691-5c62-45ee-b995-d87b5942df34" containerName="extract" Jun 14 03:20:30.796834 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.796818 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" Jun 14 03:20:30.799096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.799072 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-x6k2v\"" Jun 14 03:20:30.806229 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.806204 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz"] Jun 14 03:20:30.855534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.855496 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtgf8\" (UniqueName: \"kubernetes.io/projected/3e966f90-867f-4855-aa98-6226c3b9ade7-kube-api-access-jtgf8\") pod \"cert-manager-cainjector-5d99449ffd-2sxsz\" (UID: \"3e966f90-867f-4855-aa98-6226c3b9ade7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" Jun 14 03:20:30.855534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.855535 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e966f90-867f-4855-aa98-6226c3b9ade7-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2sxsz\" (UID: \"3e966f90-867f-4855-aa98-6226c3b9ade7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" Jun 14 03:20:30.956497 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.956464 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtgf8\" (UniqueName: \"kubernetes.io/projected/3e966f90-867f-4855-aa98-6226c3b9ade7-kube-api-access-jtgf8\") pod \"cert-manager-cainjector-5d99449ffd-2sxsz\" (UID: \"3e966f90-867f-4855-aa98-6226c3b9ade7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" Jun 14 03:20:30.956497 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.956500 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e966f90-867f-4855-aa98-6226c3b9ade7-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2sxsz\" (UID: \"3e966f90-867f-4855-aa98-6226c3b9ade7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" Jun 14 03:20:30.963962 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.963925 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3e966f90-867f-4855-aa98-6226c3b9ade7-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-2sxsz\" (UID: \"3e966f90-867f-4855-aa98-6226c3b9ade7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" Jun 14 03:20:30.964067 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:30.963973 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtgf8\" (UniqueName: \"kubernetes.io/projected/3e966f90-867f-4855-aa98-6226c3b9ade7-kube-api-access-jtgf8\") pod \"cert-manager-cainjector-5d99449ffd-2sxsz\" (UID: \"3e966f90-867f-4855-aa98-6226c3b9ade7\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" Jun 14 03:20:31.105514 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:31.105425 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" Jun 14 03:20:31.234717 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:31.234544 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz"] Jun 14 03:20:31.237347 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:20:31.237319 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e966f90_867f_4855_aa98_6226c3b9ade7.slice/crio-ed9c4e52348451d5a33ddb938101da78ca27edd41f3554a3a820bd4bc46e648d WatchSource:0}: Error finding container ed9c4e52348451d5a33ddb938101da78ca27edd41f3554a3a820bd4bc46e648d: Status 404 returned error can't find the container with id ed9c4e52348451d5a33ddb938101da78ca27edd41f3554a3a820bd4bc46e648d Jun 14 03:20:31.931831 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:31.931772 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:32.005383 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:32.005348 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" event={"ID":"3e966f90-867f-4855-aa98-6226c3b9ade7","Type":"ContainerStarted","Data":"96e65a09e3b726ac48c1f76ac03f44ff069dac6ef32890aeaab87691a1dd085e"} Jun 14 03:20:32.005529 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:32.005393 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" event={"ID":"3e966f90-867f-4855-aa98-6226c3b9ade7","Type":"ContainerStarted","Data":"ed9c4e52348451d5a33ddb938101da78ca27edd41f3554a3a820bd4bc46e648d"} Jun 14 03:20:32.031534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:32.031474 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-2sxsz" podStartSLOduration=2.031455455 podStartE2EDuration="2.031455455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:20:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:20:32.029091762 +0000 UTC m=+455.144705960" watchObservedRunningTime="2026-06-14 03:20:32.031455455 +0000 UTC m=+455.147069653" Jun 14 03:20:32.040294 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:32.040246 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:36.107688 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:36.107605 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:36.208138 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:36.208094 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:37.888546 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:37.888506 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch"] Jun 14 03:20:37.891144 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:37.891125 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:37.893516 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:37.893493 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 03:20:37.893632 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:37.893499 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 03:20:37.894464 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:37.894444 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nsh4l\"" Jun 14 03:20:37.899632 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:37.899610 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch"] Jun 14 03:20:38.015101 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.015068 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:38.015264 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.015110 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:38.015264 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.015150 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ksjq\" (UniqueName: \"kubernetes.io/projected/71892abd-0cb9-4a88-8101-285fcd81db65-kube-api-access-7ksjq\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:38.116351 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.116294 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:38.116351 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.116353 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:38.116564 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.116388 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ksjq\" (UniqueName: \"kubernetes.io/projected/71892abd-0cb9-4a88-8101-285fcd81db65-kube-api-access-7ksjq\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:38.116790 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.116763 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:38.116874 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.116770 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:38.125062 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.125035 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ksjq\" (UniqueName: \"kubernetes.io/projected/71892abd-0cb9-4a88-8101-285fcd81db65-kube-api-access-7ksjq\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:38.201555 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.201514 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:38.331911 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.331880 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch"] Jun 14 03:20:38.334650 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:20:38.334619 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71892abd_0cb9_4a88_8101_285fcd81db65.slice/crio-66a1210bdd96c65ab7076c0738dac491a045b62e3e644a6b2c67bf836f6f4f5f WatchSource:0}: Error finding container 66a1210bdd96c65ab7076c0738dac491a045b62e3e644a6b2c67bf836f6f4f5f: Status 404 returned error can't find the container with id 66a1210bdd96c65ab7076c0738dac491a045b62e3e644a6b2c67bf836f6f4f5f Jun 14 03:20:38.427042 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:38.427012 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:39.036349 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:39.036318 2547 generic.go:356] "Generic (PLEG): container finished" podID="71892abd-0cb9-4a88-8101-285fcd81db65" containerID="2c3f66ff6378d00279ba43d2246821a16cd339fbd8bf4650c8a2c627107d9403" exitCode=0 Jun 14 03:20:39.036778 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:39.036365 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" event={"ID":"71892abd-0cb9-4a88-8101-285fcd81db65","Type":"ContainerDied","Data":"2c3f66ff6378d00279ba43d2246821a16cd339fbd8bf4650c8a2c627107d9403"} Jun 14 03:20:39.036778 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:39.036400 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" event={"ID":"71892abd-0cb9-4a88-8101-285fcd81db65","Type":"ContainerStarted","Data":"66a1210bdd96c65ab7076c0738dac491a045b62e3e644a6b2c67bf836f6f4f5f"} Jun 14 03:20:40.042868 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:40.042831 2547 generic.go:356] "Generic (PLEG): container finished" podID="71892abd-0cb9-4a88-8101-285fcd81db65" containerID="23c23886afc0414a2d1d8f6c7445a8556c02233990fd06d93f689eff63ec817b" exitCode=0 Jun 14 03:20:40.043272 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:40.042946 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" event={"ID":"71892abd-0cb9-4a88-8101-285fcd81db65","Type":"ContainerDied","Data":"23c23886afc0414a2d1d8f6c7445a8556c02233990fd06d93f689eff63ec817b"} Jun 14 03:20:41.049901 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:41.049868 2547 generic.go:356] "Generic (PLEG): container finished" podID="71892abd-0cb9-4a88-8101-285fcd81db65" containerID="2358c3d19e10391b9d2cfee905f2dfaa4c3f52f263f7ba4d05388c0459ce1481" exitCode=0 Jun 14 03:20:41.050296 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:41.049913 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" event={"ID":"71892abd-0cb9-4a88-8101-285fcd81db65","Type":"ContainerDied","Data":"2358c3d19e10391b9d2cfee905f2dfaa4c3f52f263f7ba4d05388c0459ce1481"} Jun 14 03:20:42.181184 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:42.181159 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:42.349556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:42.349473 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ksjq\" (UniqueName: \"kubernetes.io/projected/71892abd-0cb9-4a88-8101-285fcd81db65-kube-api-access-7ksjq\") pod \"71892abd-0cb9-4a88-8101-285fcd81db65\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " Jun 14 03:20:42.349556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:42.349513 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-bundle\") pod \"71892abd-0cb9-4a88-8101-285fcd81db65\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " Jun 14 03:20:42.349734 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:42.349566 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-util\") pod \"71892abd-0cb9-4a88-8101-285fcd81db65\" (UID: \"71892abd-0cb9-4a88-8101-285fcd81db65\") " Jun 14 03:20:42.350247 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:42.350217 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-bundle" (OuterVolumeSpecName: "bundle") pod "71892abd-0cb9-4a88-8101-285fcd81db65" (UID: "71892abd-0cb9-4a88-8101-285fcd81db65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:20:42.351519 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:42.351492 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71892abd-0cb9-4a88-8101-285fcd81db65-kube-api-access-7ksjq" (OuterVolumeSpecName: "kube-api-access-7ksjq") pod "71892abd-0cb9-4a88-8101-285fcd81db65" (UID: "71892abd-0cb9-4a88-8101-285fcd81db65"). InnerVolumeSpecName "kube-api-access-7ksjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:20:42.355359 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:42.355337 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-util" (OuterVolumeSpecName: "util") pod "71892abd-0cb9-4a88-8101-285fcd81db65" (UID: "71892abd-0cb9-4a88-8101-285fcd81db65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:20:42.450816 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:42.450757 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-util\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:20:42.450816 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:42.450793 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ksjq\" (UniqueName: \"kubernetes.io/projected/71892abd-0cb9-4a88-8101-285fcd81db65-kube-api-access-7ksjq\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:20:42.451001 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:42.450827 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71892abd-0cb9-4a88-8101-285fcd81db65-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:20:43.060854 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:43.060813 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" event={"ID":"71892abd-0cb9-4a88-8101-285fcd81db65","Type":"ContainerDied","Data":"66a1210bdd96c65ab7076c0738dac491a045b62e3e644a6b2c67bf836f6f4f5f"} Jun 14 03:20:43.061058 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:43.060868 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66a1210bdd96c65ab7076c0738dac491a045b62e3e644a6b2c67bf836f6f4f5f" Jun 14 03:20:43.061058 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:43.060825 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdcqdch" Jun 14 03:20:49.936238 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:49.936192 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:50.036450 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:50.036410 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:52.703975 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:52.703936 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:52.800588 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:52.800552 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:53.828205 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:53.828163 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:53.923958 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:53.923922 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:54.429094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.429060 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:54.834962 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.834866 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:54.933304 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.933272 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:54.951816 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.951772 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2"] Jun 14 03:20:54.952066 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.952053 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71892abd-0cb9-4a88-8101-285fcd81db65" containerName="pull" Jun 14 03:20:54.952111 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.952067 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="71892abd-0cb9-4a88-8101-285fcd81db65" containerName="pull" Jun 14 03:20:54.952111 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.952081 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71892abd-0cb9-4a88-8101-285fcd81db65" containerName="extract" Jun 14 03:20:54.952111 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.952086 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="71892abd-0cb9-4a88-8101-285fcd81db65" containerName="extract" Jun 14 03:20:54.952111 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.952099 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71892abd-0cb9-4a88-8101-285fcd81db65" containerName="util" Jun 14 03:20:54.952111 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.952105 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="71892abd-0cb9-4a88-8101-285fcd81db65" containerName="util" Jun 14 03:20:54.952276 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.952153 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="71892abd-0cb9-4a88-8101-285fcd81db65" containerName="extract" Jun 14 03:20:54.955993 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.955976 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:54.958689 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.958664 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 03:20:54.958811 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.958671 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 03:20:54.958885 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.958674 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 03:20:54.959117 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.959098 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jbsvm\"" Jun 14 03:20:54.962218 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.962199 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 03:20:54.977285 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:54.977261 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2"] Jun 14 03:20:55.058177 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.058144 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scd6t\" (UniqueName: \"kubernetes.io/projected/b8eae150-0473-4f2b-97f4-b85b65f62d69-kube-api-access-scd6t\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.058377 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.058184 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8eae150-0473-4f2b-97f4-b85b65f62d69-tmp\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.058377 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.058212 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8eae150-0473-4f2b-97f4-b85b65f62d69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.058377 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.058301 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8eae150-0473-4f2b-97f4-b85b65f62d69-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.058377 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.058343 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b8eae150-0473-4f2b-97f4-b85b65f62d69-manifests\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.087353 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.087263 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:55.158940 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.158903 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b8eae150-0473-4f2b-97f4-b85b65f62d69-manifests\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.159134 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.158958 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scd6t\" (UniqueName: \"kubernetes.io/projected/b8eae150-0473-4f2b-97f4-b85b65f62d69-kube-api-access-scd6t\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.159134 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.158993 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8eae150-0473-4f2b-97f4-b85b65f62d69-tmp\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.159134 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.159029 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8eae150-0473-4f2b-97f4-b85b65f62d69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.159134 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.159070 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8eae150-0473-4f2b-97f4-b85b65f62d69-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.159390 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.159366 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b8eae150-0473-4f2b-97f4-b85b65f62d69-manifests\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.161443 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.161414 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8eae150-0473-4f2b-97f4-b85b65f62d69-tmp\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.161563 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.161544 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8eae150-0473-4f2b-97f4-b85b65f62d69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.161607 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.161544 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8eae150-0473-4f2b-97f4-b85b65f62d69-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.166987 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.166964 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scd6t\" (UniqueName: \"kubernetes.io/projected/b8eae150-0473-4f2b-97f4-b85b65f62d69-kube-api-access-scd6t\") pod \"opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2\" (UID: \"b8eae150-0473-4f2b-97f4-b85b65f62d69\") " pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.191777 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.191749 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:55.266873 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.266793 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:20:55.302090 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.302055 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:55.396519 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.396463 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:55.427983 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.427951 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2"] Jun 14 03:20:55.431880 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:20:55.431849 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8eae150_0473_4f2b_97f4_b85b65f62d69.slice/crio-e36cdb0084adff0819c1117ae44a2b0dd2a28e0ed1fab4e4b1116f3166078ea0 WatchSource:0}: Error finding container e36cdb0084adff0819c1117ae44a2b0dd2a28e0ed1fab4e4b1116f3166078ea0: Status 404 returned error can't find the container with id e36cdb0084adff0819c1117ae44a2b0dd2a28e0ed1fab4e4b1116f3166078ea0 Jun 14 03:20:55.498997 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:55.498964 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:20:56.118499 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:56.118446 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" event={"ID":"b8eae150-0473-4f2b-97f4-b85b65f62d69","Type":"ContainerStarted","Data":"e36cdb0084adff0819c1117ae44a2b0dd2a28e0ed1fab4e4b1116f3166078ea0"} Jun 14 03:20:59.134241 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:20:59.134202 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" event={"ID":"b8eae150-0473-4f2b-97f4-b85b65f62d69","Type":"ContainerStarted","Data":"1d583bcdea5935454d7db74057a73b89ff66247c4c333feb30d0ed7ccf900862"} Jun 14 03:21:00.140544 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:00.140508 2547 generic.go:356] "Generic (PLEG): container finished" podID="b8eae150-0473-4f2b-97f4-b85b65f62d69" containerID="1d583bcdea5935454d7db74057a73b89ff66247c4c333feb30d0ed7ccf900862" exitCode=0 Jun 14 03:21:00.140544 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:00.140548 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" event={"ID":"b8eae150-0473-4f2b-97f4-b85b65f62d69","Type":"ContainerDied","Data":"1d583bcdea5935454d7db74057a73b89ff66247c4c333feb30d0ed7ccf900862"} Jun 14 03:21:01.146978 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:01.146936 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" event={"ID":"b8eae150-0473-4f2b-97f4-b85b65f62d69","Type":"ContainerStarted","Data":"eb074a5564cc6d51361e1c2df87337418376b571306d41b8fa0302435b641ec9"} Jun 14 03:21:01.147397 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:01.147079 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:21:01.169443 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:01.169388 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" podStartSLOduration=2.826404987 podStartE2EDuration="7.169371858s" totalImagesPullingTime="3.393383187s" totalInitContainerRuntime="949.583684ms" isStatefulPod=false podCreationTimestamp="2026-06-14 03:20:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:01.167343518 +0000 UTC m=+484.282957717" watchObservedRunningTime="2026-06-14 03:21:01.169371858 +0000 UTC m=+484.284986054" Jun 14 03:21:12.154477 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:12.154432 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2" Jun 14 03:21:13.958417 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:13.958365 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:14.086284 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.086248 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:14.246959 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.246866 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:14.356245 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.356218 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:14.471649 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.471610 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:14.676525 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.676485 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:14.712292 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.712261 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2"] Jun 14 03:21:14.720620 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.720596 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:14.723284 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.723253 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 03:21:14.724318 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.724298 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 03:21:14.724410 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.724358 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 03:21:14.724484 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.724467 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jxgfs\"" Jun 14 03:21:14.724537 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.724476 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 03:21:14.733272 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.733248 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2"] Jun 14 03:21:14.826618 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.826581 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d358c1c-89be-4c80-ae5b-c5b230ffcd35-tls-certs\") pod \"kube-auth-proxy-5b6fc8f5d7-4qcj2\" (UID: \"5d358c1c-89be-4c80-ae5b-c5b230ffcd35\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:14.826847 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.826716 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d358c1c-89be-4c80-ae5b-c5b230ffcd35-tmp\") pod \"kube-auth-proxy-5b6fc8f5d7-4qcj2\" (UID: \"5d358c1c-89be-4c80-ae5b-c5b230ffcd35\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:14.826847 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.826747 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4b4f\" (UniqueName: \"kubernetes.io/projected/5d358c1c-89be-4c80-ae5b-c5b230ffcd35-kube-api-access-p4b4f\") pod \"kube-auth-proxy-5b6fc8f5d7-4qcj2\" (UID: \"5d358c1c-89be-4c80-ae5b-c5b230ffcd35\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:14.927270 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.927170 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d358c1c-89be-4c80-ae5b-c5b230ffcd35-tmp\") pod \"kube-auth-proxy-5b6fc8f5d7-4qcj2\" (UID: \"5d358c1c-89be-4c80-ae5b-c5b230ffcd35\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:14.927270 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.927211 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4b4f\" (UniqueName: \"kubernetes.io/projected/5d358c1c-89be-4c80-ae5b-c5b230ffcd35-kube-api-access-p4b4f\") pod \"kube-auth-proxy-5b6fc8f5d7-4qcj2\" (UID: \"5d358c1c-89be-4c80-ae5b-c5b230ffcd35\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:14.927270 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.927260 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d358c1c-89be-4c80-ae5b-c5b230ffcd35-tls-certs\") pod \"kube-auth-proxy-5b6fc8f5d7-4qcj2\" (UID: \"5d358c1c-89be-4c80-ae5b-c5b230ffcd35\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:14.929467 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.929442 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d358c1c-89be-4c80-ae5b-c5b230ffcd35-tmp\") pod \"kube-auth-proxy-5b6fc8f5d7-4qcj2\" (UID: \"5d358c1c-89be-4c80-ae5b-c5b230ffcd35\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:14.929764 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.929742 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d358c1c-89be-4c80-ae5b-c5b230ffcd35-tls-certs\") pod \"kube-auth-proxy-5b6fc8f5d7-4qcj2\" (UID: \"5d358c1c-89be-4c80-ae5b-c5b230ffcd35\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:14.936012 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:14.935991 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4b4f\" (UniqueName: \"kubernetes.io/projected/5d358c1c-89be-4c80-ae5b-c5b230ffcd35-kube-api-access-p4b4f\") pod \"kube-auth-proxy-5b6fc8f5d7-4qcj2\" (UID: \"5d358c1c-89be-4c80-ae5b-c5b230ffcd35\") " pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:15.029617 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.029401 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" Jun 14 03:21:15.032157 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.032121 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-jlhv9"] Jun 14 03:21:15.038426 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.038405 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:15.041106 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.041082 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 14 03:21:15.041227 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.041125 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rjzbr\"" Jun 14 03:21:15.046045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.046022 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-jlhv9"] Jun 14 03:21:15.069658 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.069632 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:15.129261 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.129224 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8c45c8e-f2b6-4fb8-a582-2f29f59eb658-cert\") pod \"odh-model-controller-6dc94f689f-jlhv9\" (UID: \"e8c45c8e-f2b6-4fb8-a582-2f29f59eb658\") " pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:15.129399 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.129371 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjfxb\" (UniqueName: \"kubernetes.io/projected/e8c45c8e-f2b6-4fb8-a582-2f29f59eb658-kube-api-access-hjfxb\") pod \"odh-model-controller-6dc94f689f-jlhv9\" (UID: \"e8c45c8e-f2b6-4fb8-a582-2f29f59eb658\") " pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:15.167567 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.167534 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:15.179166 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.179145 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2"] Jun 14 03:21:15.181325 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:21:15.181297 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d358c1c_89be_4c80_ae5b_c5b230ffcd35.slice/crio-3ec550c6cb7536414e0c336ac277182a77aac1444455cdc605bb668f1aa7d4d7 WatchSource:0}: Error finding container 3ec550c6cb7536414e0c336ac277182a77aac1444455cdc605bb668f1aa7d4d7: Status 404 returned error can't find the container with id 3ec550c6cb7536414e0c336ac277182a77aac1444455cdc605bb668f1aa7d4d7 Jun 14 03:21:15.209214 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.209180 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" event={"ID":"5d358c1c-89be-4c80-ae5b-c5b230ffcd35","Type":"ContainerStarted","Data":"3ec550c6cb7536414e0c336ac277182a77aac1444455cdc605bb668f1aa7d4d7"} Jun 14 03:21:15.224874 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.224840 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:15.230019 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.229995 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjfxb\" (UniqueName: \"kubernetes.io/projected/e8c45c8e-f2b6-4fb8-a582-2f29f59eb658-kube-api-access-hjfxb\") pod \"odh-model-controller-6dc94f689f-jlhv9\" (UID: \"e8c45c8e-f2b6-4fb8-a582-2f29f59eb658\") " pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:15.230113 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.230053 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8c45c8e-f2b6-4fb8-a582-2f29f59eb658-cert\") pod \"odh-model-controller-6dc94f689f-jlhv9\" (UID: \"e8c45c8e-f2b6-4fb8-a582-2f29f59eb658\") " pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:15.230162 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:21:15.230150 2547 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 14 03:21:15.230219 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:21:15.230210 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c45c8e-f2b6-4fb8-a582-2f29f59eb658-cert podName:e8c45c8e-f2b6-4fb8-a582-2f29f59eb658 nodeName:}" failed. No retries permitted until 2026-06-14 03:21:15.730194532 +0000 UTC m=+498.845808709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e8c45c8e-f2b6-4fb8-a582-2f29f59eb658-cert") pod "odh-model-controller-6dc94f689f-jlhv9" (UID: "e8c45c8e-f2b6-4fb8-a582-2f29f59eb658") : secret "odh-model-controller-webhook-cert" not found Jun 14 03:21:15.248902 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.248872 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjfxb\" (UniqueName: \"kubernetes.io/projected/e8c45c8e-f2b6-4fb8-a582-2f29f59eb658-kube-api-access-hjfxb\") pod \"odh-model-controller-6dc94f689f-jlhv9\" (UID: \"e8c45c8e-f2b6-4fb8-a582-2f29f59eb658\") " pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:15.485912 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.485829 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:15.565307 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.565262 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9kdgn"] Jun 14 03:21:15.566044 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.566017 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:15.570148 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.570127 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" Jun 14 03:21:15.572561 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.572543 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 14 03:21:15.572645 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.572551 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-bkl2s\"" Jun 14 03:21:15.578112 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.578094 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9kdgn"] Jun 14 03:21:15.633365 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.633328 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b350850-a567-45b4-9a11-ddd5a7ecdae6-tls-certs\") pod \"model-serving-api-5dd488fc48-9kdgn\" (UID: \"5b350850-a567-45b4-9a11-ddd5a7ecdae6\") " pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" Jun 14 03:21:15.633547 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.633383 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnzrs\" (UniqueName: \"kubernetes.io/projected/5b350850-a567-45b4-9a11-ddd5a7ecdae6-kube-api-access-qnzrs\") pod \"model-serving-api-5dd488fc48-9kdgn\" (UID: \"5b350850-a567-45b4-9a11-ddd5a7ecdae6\") " pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" Jun 14 03:21:15.685622 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.685588 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:15.734090 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.734049 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b350850-a567-45b4-9a11-ddd5a7ecdae6-tls-certs\") pod \"model-serving-api-5dd488fc48-9kdgn\" (UID: \"5b350850-a567-45b4-9a11-ddd5a7ecdae6\") " pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" Jun 14 03:21:15.734289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.734119 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnzrs\" (UniqueName: \"kubernetes.io/projected/5b350850-a567-45b4-9a11-ddd5a7ecdae6-kube-api-access-qnzrs\") pod \"model-serving-api-5dd488fc48-9kdgn\" (UID: \"5b350850-a567-45b4-9a11-ddd5a7ecdae6\") " pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" Jun 14 03:21:15.734289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.734170 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8c45c8e-f2b6-4fb8-a582-2f29f59eb658-cert\") pod \"odh-model-controller-6dc94f689f-jlhv9\" (UID: \"e8c45c8e-f2b6-4fb8-a582-2f29f59eb658\") " pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:15.736674 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.736618 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8c45c8e-f2b6-4fb8-a582-2f29f59eb658-cert\") pod \"odh-model-controller-6dc94f689f-jlhv9\" (UID: \"e8c45c8e-f2b6-4fb8-a582-2f29f59eb658\") " pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:15.736674 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.736621 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b350850-a567-45b4-9a11-ddd5a7ecdae6-tls-certs\") pod \"model-serving-api-5dd488fc48-9kdgn\" (UID: \"5b350850-a567-45b4-9a11-ddd5a7ecdae6\") " pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" Jun 14 03:21:15.741447 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.741421 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnzrs\" (UniqueName: \"kubernetes.io/projected/5b350850-a567-45b4-9a11-ddd5a7ecdae6-kube-api-access-qnzrs\") pod \"model-serving-api-5dd488fc48-9kdgn\" (UID: \"5b350850-a567-45b4-9a11-ddd5a7ecdae6\") " pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" Jun 14 03:21:15.881213 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.881181 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" Jun 14 03:21:15.963749 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:15.963545 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:16.040962 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:16.039184 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-9kdgn"] Jun 14 03:21:16.119711 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:16.119668 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-jlhv9"] Jun 14 03:21:16.122109 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:21:16.122082 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c45c8e_f2b6_4fb8_a582_2f29f59eb658.slice/crio-b72084f2cbcfdf98983d53661494f2452267528e78d1c233f06942d92fd315de WatchSource:0}: Error finding container b72084f2cbcfdf98983d53661494f2452267528e78d1c233f06942d92fd315de: Status 404 returned error can't find the container with id b72084f2cbcfdf98983d53661494f2452267528e78d1c233f06942d92fd315de Jun 14 03:21:16.218928 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:16.218892 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" event={"ID":"e8c45c8e-f2b6-4fb8-a582-2f29f59eb658","Type":"ContainerStarted","Data":"b72084f2cbcfdf98983d53661494f2452267528e78d1c233f06942d92fd315de"} Jun 14 03:21:16.220273 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:16.220233 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" event={"ID":"5b350850-a567-45b4-9a11-ddd5a7ecdae6","Type":"ContainerStarted","Data":"8349e1110da6d3ac2907bf2215220546ee629c42cac39519ef9dc0651518e248"} Jun 14 03:21:17.425333 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.423545 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v"] Jun 14 03:21:17.433741 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.433677 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:17.437119 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.436590 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nsh4l\"" Jun 14 03:21:17.437119 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.436729 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v"] Jun 14 03:21:17.440454 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.438346 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 03:21:17.440454 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.439244 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 03:21:17.551123 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.551069 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:17.551343 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.551139 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:17.551343 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.551222 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jfk7\" (UniqueName: \"kubernetes.io/projected/cc596228-37bf-4d53-9e66-213594b165bd-kube-api-access-2jfk7\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:17.652588 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.652548 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:17.652828 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.652623 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:17.652828 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.652684 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jfk7\" (UniqueName: \"kubernetes.io/projected/cc596228-37bf-4d53-9e66-213594b165bd-kube-api-access-2jfk7\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:17.653151 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.653124 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:17.653271 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.653165 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:17.663635 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.663504 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jfk7\" (UniqueName: \"kubernetes.io/projected/cc596228-37bf-4d53-9e66-213594b165bd-kube-api-access-2jfk7\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:17.754412 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:17.754133 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:20.416006 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:20.415974 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v"] Jun 14 03:21:20.418772 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:21:20.418738 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc596228_37bf_4d53_9e66_213594b165bd.slice/crio-c79bee18f3afa9a12c69ff77c4d79c1ac1fc3eef60b307dc192ee29307c417d2 WatchSource:0}: Error finding container c79bee18f3afa9a12c69ff77c4d79c1ac1fc3eef60b307dc192ee29307c417d2: Status 404 returned error can't find the container with id c79bee18f3afa9a12c69ff77c4d79c1ac1fc3eef60b307dc192ee29307c417d2 Jun 14 03:21:21.252441 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.252407 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" event={"ID":"5b350850-a567-45b4-9a11-ddd5a7ecdae6","Type":"ContainerStarted","Data":"9ea01624ed7a485fa33eae0ea50e3b9ae0b3cd885ed72632cf297299381cfca3"} Jun 14 03:21:21.252645 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.252614 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" Jun 14 03:21:21.253912 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.253886 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" event={"ID":"5d358c1c-89be-4c80-ae5b-c5b230ffcd35","Type":"ContainerStarted","Data":"f8919085a339836b75216f8121008308a04500cd3fbe368286c18765938b1d6d"} Jun 14 03:21:21.255263 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.255237 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" event={"ID":"e8c45c8e-f2b6-4fb8-a582-2f29f59eb658","Type":"ContainerStarted","Data":"0b810ef9362996f780f4484a11f52527dc919939c760a8cee813634bf6f7503f"} Jun 14 03:21:21.255362 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.255317 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:21.256705 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.256683 2547 generic.go:356] "Generic (PLEG): container finished" podID="cc596228-37bf-4d53-9e66-213594b165bd" containerID="6030f3b8e85e15bb0fc1059ddf0d3501fdb93a5d1474625ebf8234a7a035dd91" exitCode=0 Jun 14 03:21:21.256787 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.256751 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" event={"ID":"cc596228-37bf-4d53-9e66-213594b165bd","Type":"ContainerDied","Data":"6030f3b8e85e15bb0fc1059ddf0d3501fdb93a5d1474625ebf8234a7a035dd91"} Jun 14 03:21:21.256787 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.256780 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" event={"ID":"cc596228-37bf-4d53-9e66-213594b165bd","Type":"ContainerStarted","Data":"c79bee18f3afa9a12c69ff77c4d79c1ac1fc3eef60b307dc192ee29307c417d2"} Jun 14 03:21:21.279995 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.279943 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" podStartSLOduration=2.057795068 podStartE2EDuration="6.279922082s" totalImagesPullingTime="4.222127014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:21.279671881 +0000 UTC m=+504.395286105" watchObservedRunningTime="2026-06-14 03:21:21.279922082 +0000 UTC m=+504.395536282" Jun 14 03:21:21.313434 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.313379 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b6fc8f5d7-4qcj2" podStartSLOduration=2.230525064 podStartE2EDuration="7.313361553s" totalImagesPullingTime="5.082836489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:21.312089116 +0000 UTC m=+504.427703351" watchObservedRunningTime="2026-06-14 03:21:21.313361553 +0000 UTC m=+504.428975752" Jun 14 03:21:21.330336 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:21.330279 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" podStartSLOduration=2.137944292 podStartE2EDuration="6.330261482s" totalImagesPullingTime="4.19231719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:21.330028854 +0000 UTC m=+504.445643053" watchObservedRunningTime="2026-06-14 03:21:21.330261482 +0000 UTC m=+504.445875680" Jun 14 03:21:22.272416 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:22.272378 2547 generic.go:356] "Generic (PLEG): container finished" podID="cc596228-37bf-4d53-9e66-213594b165bd" containerID="cded48124dd641bf6ad5267bd5e85b4936b326478b83f1982a56a840a965ff94" exitCode=0 Jun 14 03:21:22.272922 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:22.272469 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" event={"ID":"cc596228-37bf-4d53-9e66-213594b165bd","Type":"ContainerDied","Data":"cded48124dd641bf6ad5267bd5e85b4936b326478b83f1982a56a840a965ff94"} Jun 14 03:21:23.285331 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:23.285299 2547 generic.go:356] "Generic (PLEG): container finished" podID="cc596228-37bf-4d53-9e66-213594b165bd" containerID="509c5fae8041639ca2fd4c43a255fd991a2a717a28b311d7d306b9f307c8f51c" exitCode=0 Jun 14 03:21:23.285729 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:23.285343 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" event={"ID":"cc596228-37bf-4d53-9e66-213594b165bd","Type":"ContainerDied","Data":"509c5fae8041639ca2fd4c43a255fd991a2a717a28b311d7d306b9f307c8f51c"} Jun 14 03:21:23.925025 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:23.924984 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:23.979358 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:23.979327 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-nbmxx"] Jun 14 03:21:23.982484 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:23.982467 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:21:23.984857 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:23.984833 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 14 03:21:23.984982 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:23.984937 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vf54l\"" Jun 14 03:21:23.995514 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:23.995478 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-nbmxx"] Jun 14 03:21:23.997485 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:23.997459 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr"] Jun 14 03:21:24.000743 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.000722 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:21:24.003032 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.003012 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 14 03:21:24.003134 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.003060 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-n5bl2\"" Jun 14 03:21:24.010666 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.010643 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr"] Jun 14 03:21:24.017005 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.016972 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:24.109745 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.109708 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0dad2ce-1296-4da7-a3c0-76a3c68ba96d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-586wr\" (UID: \"f0dad2ce-1296-4da7-a3c0-76a3c68ba96d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:21:24.109745 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.109747 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg5lq\" (UniqueName: \"kubernetes.io/projected/19dc042e-08b6-4d3a-b7fb-76f42b38f6bd-kube-api-access-lg5lq\") pod \"kserve-controller-manager-69fc866d76-nbmxx\" (UID: \"19dc042e-08b6-4d3a-b7fb-76f42b38f6bd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:21:24.109967 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.109775 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgzpx\" (UniqueName: \"kubernetes.io/projected/f0dad2ce-1296-4da7-a3c0-76a3c68ba96d-kube-api-access-tgzpx\") pod \"llmisvc-controller-manager-864bfd7bc9-586wr\" (UID: \"f0dad2ce-1296-4da7-a3c0-76a3c68ba96d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:21:24.109967 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.109797 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dc042e-08b6-4d3a-b7fb-76f42b38f6bd-cert\") pod \"kserve-controller-manager-69fc866d76-nbmxx\" (UID: \"19dc042e-08b6-4d3a-b7fb-76f42b38f6bd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:21:24.210588 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.210485 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0dad2ce-1296-4da7-a3c0-76a3c68ba96d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-586wr\" (UID: \"f0dad2ce-1296-4da7-a3c0-76a3c68ba96d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:21:24.210588 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.210531 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg5lq\" (UniqueName: \"kubernetes.io/projected/19dc042e-08b6-4d3a-b7fb-76f42b38f6bd-kube-api-access-lg5lq\") pod \"kserve-controller-manager-69fc866d76-nbmxx\" (UID: \"19dc042e-08b6-4d3a-b7fb-76f42b38f6bd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:21:24.210588 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.210567 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgzpx\" (UniqueName: \"kubernetes.io/projected/f0dad2ce-1296-4da7-a3c0-76a3c68ba96d-kube-api-access-tgzpx\") pod \"llmisvc-controller-manager-864bfd7bc9-586wr\" (UID: \"f0dad2ce-1296-4da7-a3c0-76a3c68ba96d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:21:24.210897 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.210596 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dc042e-08b6-4d3a-b7fb-76f42b38f6bd-cert\") pod \"kserve-controller-manager-69fc866d76-nbmxx\" (UID: \"19dc042e-08b6-4d3a-b7fb-76f42b38f6bd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:21:24.210897 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:21:24.210649 2547 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 14 03:21:24.210897 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:21:24.210709 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0dad2ce-1296-4da7-a3c0-76a3c68ba96d-cert podName:f0dad2ce-1296-4da7-a3c0-76a3c68ba96d nodeName:}" failed. No retries permitted until 2026-06-14 03:21:24.710692728 +0000 UTC m=+507.826306905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f0dad2ce-1296-4da7-a3c0-76a3c68ba96d-cert") pod "llmisvc-controller-manager-864bfd7bc9-586wr" (UID: "f0dad2ce-1296-4da7-a3c0-76a3c68ba96d") : secret "llmisvc-webhook-server-cert" not found Jun 14 03:21:24.210897 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:21:24.210782 2547 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 14 03:21:24.210897 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:21:24.210850 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19dc042e-08b6-4d3a-b7fb-76f42b38f6bd-cert podName:19dc042e-08b6-4d3a-b7fb-76f42b38f6bd nodeName:}" failed. No retries permitted until 2026-06-14 03:21:24.71083471 +0000 UTC m=+507.826448914 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19dc042e-08b6-4d3a-b7fb-76f42b38f6bd-cert") pod "kserve-controller-manager-69fc866d76-nbmxx" (UID: "19dc042e-08b6-4d3a-b7fb-76f42b38f6bd") : secret "kserve-webhook-server-cert" not found Jun 14 03:21:24.222878 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.222844 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgzpx\" (UniqueName: \"kubernetes.io/projected/f0dad2ce-1296-4da7-a3c0-76a3c68ba96d-kube-api-access-tgzpx\") pod \"llmisvc-controller-manager-864bfd7bc9-586wr\" (UID: \"f0dad2ce-1296-4da7-a3c0-76a3c68ba96d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:21:24.227078 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.227043 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg5lq\" (UniqueName: \"kubernetes.io/projected/19dc042e-08b6-4d3a-b7fb-76f42b38f6bd-kube-api-access-lg5lq\") pod \"kserve-controller-manager-69fc866d76-nbmxx\" (UID: \"19dc042e-08b6-4d3a-b7fb-76f42b38f6bd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:21:24.366668 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.366640 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:24.437034 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.437011 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:24.462358 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.462258 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:24.513640 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.513609 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-bundle\") pod \"cc596228-37bf-4d53-9e66-213594b165bd\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " Jun 14 03:21:24.513819 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.513718 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jfk7\" (UniqueName: \"kubernetes.io/projected/cc596228-37bf-4d53-9e66-213594b165bd-kube-api-access-2jfk7\") pod \"cc596228-37bf-4d53-9e66-213594b165bd\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " Jun 14 03:21:24.513819 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.513757 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-util\") pod \"cc596228-37bf-4d53-9e66-213594b165bd\" (UID: \"cc596228-37bf-4d53-9e66-213594b165bd\") " Jun 14 03:21:24.514496 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.514464 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-bundle" (OuterVolumeSpecName: "bundle") pod "cc596228-37bf-4d53-9e66-213594b165bd" (UID: "cc596228-37bf-4d53-9e66-213594b165bd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:21:24.515924 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.515899 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc596228-37bf-4d53-9e66-213594b165bd-kube-api-access-2jfk7" (OuterVolumeSpecName: "kube-api-access-2jfk7") pod "cc596228-37bf-4d53-9e66-213594b165bd" (UID: "cc596228-37bf-4d53-9e66-213594b165bd"). InnerVolumeSpecName "kube-api-access-2jfk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:21:24.519479 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.519457 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-util" (OuterVolumeSpecName: "util") pod "cc596228-37bf-4d53-9e66-213594b165bd" (UID: "cc596228-37bf-4d53-9e66-213594b165bd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:21:24.614336 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.614305 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jfk7\" (UniqueName: \"kubernetes.io/projected/cc596228-37bf-4d53-9e66-213594b165bd-kube-api-access-2jfk7\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:21:24.614336 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.614333 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-util\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:21:24.614336 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.614342 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc596228-37bf-4d53-9e66-213594b165bd-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:21:24.714862 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.714753 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0dad2ce-1296-4da7-a3c0-76a3c68ba96d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-586wr\" (UID: \"f0dad2ce-1296-4da7-a3c0-76a3c68ba96d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:21:24.714862 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.714825 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dc042e-08b6-4d3a-b7fb-76f42b38f6bd-cert\") pod \"kserve-controller-manager-69fc866d76-nbmxx\" (UID: \"19dc042e-08b6-4d3a-b7fb-76f42b38f6bd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:21:24.717177 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.717151 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0dad2ce-1296-4da7-a3c0-76a3c68ba96d-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-586wr\" (UID: \"f0dad2ce-1296-4da7-a3c0-76a3c68ba96d\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:21:24.717177 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.717162 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19dc042e-08b6-4d3a-b7fb-76f42b38f6bd-cert\") pod \"kserve-controller-manager-69fc866d76-nbmxx\" (UID: \"19dc042e-08b6-4d3a-b7fb-76f42b38f6bd\") " pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:21:24.892313 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.892280 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:21:24.912243 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:24.912216 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:21:25.062820 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:25.062773 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-nbmxx"] Jun 14 03:21:25.065345 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:21:25.065317 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19dc042e_08b6_4d3a_b7fb_76f42b38f6bd.slice/crio-f58e31808f7b70e45d3bb423855dbdb5a70f8c069236adbfa64b53e21135d15f WatchSource:0}: Error finding container f58e31808f7b70e45d3bb423855dbdb5a70f8c069236adbfa64b53e21135d15f: Status 404 returned error can't find the container with id f58e31808f7b70e45d3bb423855dbdb5a70f8c069236adbfa64b53e21135d15f Jun 14 03:21:25.099022 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:25.098997 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr"] Jun 14 03:21:25.101323 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:21:25.101297 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf0dad2ce_1296_4da7_a3c0_76a3c68ba96d.slice/crio-dab6357d7381e9a5dc9ba9c002837a4f1ddf714e9f42fdf49b036a66b7763c27 WatchSource:0}: Error finding container dab6357d7381e9a5dc9ba9c002837a4f1ddf714e9f42fdf49b036a66b7763c27: Status 404 returned error can't find the container with id dab6357d7381e9a5dc9ba9c002837a4f1ddf714e9f42fdf49b036a66b7763c27 Jun 14 03:21:25.199595 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:25.199558 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:25.296034 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:25.295947 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" event={"ID":"f0dad2ce-1296-4da7-a3c0-76a3c68ba96d","Type":"ContainerStarted","Data":"dab6357d7381e9a5dc9ba9c002837a4f1ddf714e9f42fdf49b036a66b7763c27"} Jun 14 03:21:25.297372 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:25.297312 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" event={"ID":"19dc042e-08b6-4d3a-b7fb-76f42b38f6bd","Type":"ContainerStarted","Data":"f58e31808f7b70e45d3bb423855dbdb5a70f8c069236adbfa64b53e21135d15f"} Jun 14 03:21:25.298104 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:25.298075 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:25.299445 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:25.299410 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" event={"ID":"cc596228-37bf-4d53-9e66-213594b165bd","Type":"ContainerDied","Data":"c79bee18f3afa9a12c69ff77c4d79c1ac1fc3eef60b307dc192ee29307c417d2"} Jun 14 03:21:25.299548 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:25.299446 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0668g4v" Jun 14 03:21:25.299548 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:25.299460 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c79bee18f3afa9a12c69ff77c4d79c1ac1fc3eef60b307dc192ee29307c417d2" Jun 14 03:21:25.368254 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:25.368225 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:28.319561 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:28.319518 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" event={"ID":"19dc042e-08b6-4d3a-b7fb-76f42b38f6bd","Type":"ContainerStarted","Data":"35d9c09733c7e7eb7befb4eb19069254026efc87a5256cd89704d7626eec567e"} Jun 14 03:21:28.320090 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:28.319622 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:21:28.339193 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:28.339136 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" podStartSLOduration=2.535529166 podStartE2EDuration="5.339114539s" totalImagesPullingTime="2.803585373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:28.337448275 +0000 UTC m=+511.453062471" watchObservedRunningTime="2026-06-14 03:21:28.339114539 +0000 UTC m=+511.454728742" Jun 14 03:21:29.326298 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:29.326262 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" event={"ID":"f0dad2ce-1296-4da7-a3c0-76a3c68ba96d","Type":"ContainerStarted","Data":"56739cc238a7efc048e040323007f123f993d6f5be764aebf87e41ffd8a5d212"} Jun 14 03:21:29.326739 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:29.326570 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:21:29.341788 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:29.341742 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" podStartSLOduration=2.629354785 podStartE2EDuration="6.341722992s" totalImagesPullingTime="3.712368207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:29.34038696 +0000 UTC m=+512.456001194" watchObservedRunningTime="2026-06-14 03:21:29.341722992 +0000 UTC m=+512.457337191" Jun 14 03:21:31.026302 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:31.026271 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:31.122234 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:31.122194 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:32.274466 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.274420 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-jlhv9" Jun 14 03:21:32.276815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.276774 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-9kdgn" Jun 14 03:21:32.283495 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.283452 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:32.394850 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.394816 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs"] Jun 14 03:21:32.395158 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.395146 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc596228-37bf-4d53-9e66-213594b165bd" containerName="util" Jun 14 03:21:32.395202 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.395160 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc596228-37bf-4d53-9e66-213594b165bd" containerName="util" Jun 14 03:21:32.395202 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.395181 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc596228-37bf-4d53-9e66-213594b165bd" containerName="pull" Jun 14 03:21:32.395202 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.395186 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc596228-37bf-4d53-9e66-213594b165bd" containerName="pull" Jun 14 03:21:32.395202 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.395195 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc596228-37bf-4d53-9e66-213594b165bd" containerName="extract" Jun 14 03:21:32.395336 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.395200 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc596228-37bf-4d53-9e66-213594b165bd" containerName="extract" Jun 14 03:21:32.395336 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.395287 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc596228-37bf-4d53-9e66-213594b165bd" containerName="extract" Jun 14 03:21:32.398293 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.398267 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:32.398696 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.398680 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.404168 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.404150 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 03:21:32.404724 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.404705 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nsh4l\"" Jun 14 03:21:32.404826 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.404795 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 03:21:32.421381 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.421353 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs"] Jun 14 03:21:32.483676 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.483644 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.483676 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.483677 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txnkv\" (UniqueName: \"kubernetes.io/projected/d5d500ca-8005-4f60-a9d5-ac895786d8e0-kube-api-access-txnkv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.483938 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.483705 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.585144 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.585031 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.585144 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.585089 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txnkv\" (UniqueName: \"kubernetes.io/projected/d5d500ca-8005-4f60-a9d5-ac895786d8e0-kube-api-access-txnkv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.585144 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.585130 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.585471 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.585450 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.585535 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.585504 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.606681 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.606648 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txnkv\" (UniqueName: \"kubernetes.io/projected/d5d500ca-8005-4f60-a9d5-ac895786d8e0-kube-api-access-txnkv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.708461 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.708425 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:32.845319 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.845290 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs"] Jun 14 03:21:32.847141 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:21:32.847110 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d500ca_8005_4f60_a9d5_ac895786d8e0.slice/crio-468ea783d2d7f202f76ac4fa6306a7febd8a3d1d7dc801a5d5d44e51fa2ca722 WatchSource:0}: Error finding container 468ea783d2d7f202f76ac4fa6306a7febd8a3d1d7dc801a5d5d44e51fa2ca722: Status 404 returned error can't find the container with id 468ea783d2d7f202f76ac4fa6306a7febd8a3d1d7dc801a5d5d44e51fa2ca722 Jun 14 03:21:32.955557 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:32.955517 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:33.125580 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.125435 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:33.345591 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.345560 2547 generic.go:356] "Generic (PLEG): container finished" podID="d5d500ca-8005-4f60-a9d5-ac895786d8e0" containerID="4cae3143848975d3215b74eb99882639b4542369a5e184d231103c6df72bcd9d" exitCode=0 Jun 14 03:21:33.346012 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.345633 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" event={"ID":"d5d500ca-8005-4f60-a9d5-ac895786d8e0","Type":"ContainerDied","Data":"4cae3143848975d3215b74eb99882639b4542369a5e184d231103c6df72bcd9d"} Jun 14 03:21:33.346012 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.345666 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" event={"ID":"d5d500ca-8005-4f60-a9d5-ac895786d8e0","Type":"ContainerStarted","Data":"468ea783d2d7f202f76ac4fa6306a7febd8a3d1d7dc801a5d5d44e51fa2ca722"} Jun 14 03:21:33.591787 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.591750 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:33.882097 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.882017 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7"] Jun 14 03:21:33.885357 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.885340 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" Jun 14 03:21:33.887893 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.887858 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 14 03:21:33.887893 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.887883 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 14 03:21:33.888068 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.887891 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-vzq28\"" Jun 14 03:21:33.896900 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.896879 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7"] Jun 14 03:21:33.998154 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.998121 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/fc915248-f0d2-4cb9-8b82-fa91a1dcf03c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7rtr7\" (UID: \"fc915248-f0d2-4cb9-8b82-fa91a1dcf03c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" Jun 14 03:21:33.998322 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:33.998163 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgnbw\" (UniqueName: \"kubernetes.io/projected/fc915248-f0d2-4cb9-8b82-fa91a1dcf03c-kube-api-access-cgnbw\") pod \"servicemesh-operator3-57f65f65fb-7rtr7\" (UID: \"fc915248-f0d2-4cb9-8b82-fa91a1dcf03c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" Jun 14 03:21:34.098875 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:34.098841 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgnbw\" (UniqueName: \"kubernetes.io/projected/fc915248-f0d2-4cb9-8b82-fa91a1dcf03c-kube-api-access-cgnbw\") pod \"servicemesh-operator3-57f65f65fb-7rtr7\" (UID: \"fc915248-f0d2-4cb9-8b82-fa91a1dcf03c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" Jun 14 03:21:34.099031 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:34.098969 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/fc915248-f0d2-4cb9-8b82-fa91a1dcf03c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7rtr7\" (UID: \"fc915248-f0d2-4cb9-8b82-fa91a1dcf03c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" Jun 14 03:21:34.101474 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:34.101447 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/fc915248-f0d2-4cb9-8b82-fa91a1dcf03c-operator-config\") pod \"servicemesh-operator3-57f65f65fb-7rtr7\" (UID: \"fc915248-f0d2-4cb9-8b82-fa91a1dcf03c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" Jun 14 03:21:34.116124 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:34.116093 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgnbw\" (UniqueName: \"kubernetes.io/projected/fc915248-f0d2-4cb9-8b82-fa91a1dcf03c-kube-api-access-cgnbw\") pod \"servicemesh-operator3-57f65f65fb-7rtr7\" (UID: \"fc915248-f0d2-4cb9-8b82-fa91a1dcf03c\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" Jun 14 03:21:34.196157 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:34.196134 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" Jun 14 03:21:34.354612 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:34.354581 2547 generic.go:356] "Generic (PLEG): container finished" podID="d5d500ca-8005-4f60-a9d5-ac895786d8e0" containerID="b5b442054724661b400011b16238c7e172ed46b95dc1c7764b7e43e0d6ff7254" exitCode=0 Jun 14 03:21:34.355082 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:34.354671 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" event={"ID":"d5d500ca-8005-4f60-a9d5-ac895786d8e0","Type":"ContainerDied","Data":"b5b442054724661b400011b16238c7e172ed46b95dc1c7764b7e43e0d6ff7254"} Jun 14 03:21:34.373077 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:34.373048 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7"] Jun 14 03:21:34.379846 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:21:34.379819 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc915248_f0d2_4cb9_8b82_fa91a1dcf03c.slice/crio-ae4a738ed5f0134dd073bea42ec7bad6fe296f4aa86d3b34df86844362ca1c5c WatchSource:0}: Error finding container ae4a738ed5f0134dd073bea42ec7bad6fe296f4aa86d3b34df86844362ca1c5c: Status 404 returned error can't find the container with id ae4a738ed5f0134dd073bea42ec7bad6fe296f4aa86d3b34df86844362ca1c5c Jun 14 03:21:35.365309 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:35.365270 2547 generic.go:356] "Generic (PLEG): container finished" podID="d5d500ca-8005-4f60-a9d5-ac895786d8e0" containerID="22025ebf7f8e1a7fe22fddb96be590e820cfad34274d2c31939aa8f2a1f67838" exitCode=0 Jun 14 03:21:35.365769 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:35.365366 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" event={"ID":"d5d500ca-8005-4f60-a9d5-ac895786d8e0","Type":"ContainerDied","Data":"22025ebf7f8e1a7fe22fddb96be590e820cfad34274d2c31939aa8f2a1f67838"} Jun 14 03:21:35.367449 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:35.367397 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" event={"ID":"fc915248-f0d2-4cb9-8b82-fa91a1dcf03c","Type":"ContainerStarted","Data":"ae4a738ed5f0134dd073bea42ec7bad6fe296f4aa86d3b34df86844362ca1c5c"} Jun 14 03:21:36.787908 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:36.787883 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:36.925090 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:36.925058 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txnkv\" (UniqueName: \"kubernetes.io/projected/d5d500ca-8005-4f60-a9d5-ac895786d8e0-kube-api-access-txnkv\") pod \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " Jun 14 03:21:36.925223 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:36.925145 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-bundle\") pod \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " Jun 14 03:21:36.925223 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:36.925169 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-util\") pod \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\" (UID: \"d5d500ca-8005-4f60-a9d5-ac895786d8e0\") " Jun 14 03:21:36.925985 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:36.925956 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-bundle" (OuterVolumeSpecName: "bundle") pod "d5d500ca-8005-4f60-a9d5-ac895786d8e0" (UID: "d5d500ca-8005-4f60-a9d5-ac895786d8e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:21:36.927232 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:36.927198 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d500ca-8005-4f60-a9d5-ac895786d8e0-kube-api-access-txnkv" (OuterVolumeSpecName: "kube-api-access-txnkv") pod "d5d500ca-8005-4f60-a9d5-ac895786d8e0" (UID: "d5d500ca-8005-4f60-a9d5-ac895786d8e0"). InnerVolumeSpecName "kube-api-access-txnkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:21:36.933330 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:36.933285 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-util" (OuterVolumeSpecName: "util") pod "d5d500ca-8005-4f60-a9d5-ac895786d8e0" (UID: "d5d500ca-8005-4f60-a9d5-ac895786d8e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:21:37.026339 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:37.026249 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:21:37.026339 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:37.026279 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5d500ca-8005-4f60-a9d5-ac895786d8e0-util\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:21:37.026339 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:37.026292 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txnkv\" (UniqueName: \"kubernetes.io/projected/d5d500ca-8005-4f60-a9d5-ac895786d8e0-kube-api-access-txnkv\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:21:37.380500 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:37.380463 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" event={"ID":"d5d500ca-8005-4f60-a9d5-ac895786d8e0","Type":"ContainerDied","Data":"468ea783d2d7f202f76ac4fa6306a7febd8a3d1d7dc801a5d5d44e51fa2ca722"} Jun 14 03:21:37.380854 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:37.380517 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="468ea783d2d7f202f76ac4fa6306a7febd8a3d1d7dc801a5d5d44e51fa2ca722" Jun 14 03:21:37.380854 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:37.380475 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762adwqqs" Jun 14 03:21:37.382841 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:37.382797 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" event={"ID":"fc915248-f0d2-4cb9-8b82-fa91a1dcf03c","Type":"ContainerStarted","Data":"42ad474a27ad3e7adbea116f26c1986b5feaa03f6fc0fa371a5304c1863bfe1d"} Jun 14 03:21:37.408875 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:37.408815 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" podStartSLOduration=1.96426894 podStartE2EDuration="4.408785362s" totalImagesPullingTime="2.444516422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:37.406008536 +0000 UTC m=+520.521622796" watchObservedRunningTime="2026-06-14 03:21:37.408785362 +0000 UTC m=+520.524399560" Jun 14 03:21:38.387335 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:38.387296 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" Jun 14 03:21:38.563399 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:38.563348 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:38.663957 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:38.663919 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:43.472983 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.472941 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj"] Jun 14 03:21:43.473461 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.473440 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d500ca-8005-4f60-a9d5-ac895786d8e0" containerName="pull" Jun 14 03:21:43.473535 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.473464 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d500ca-8005-4f60-a9d5-ac895786d8e0" containerName="pull" Jun 14 03:21:43.473535 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.473476 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d500ca-8005-4f60-a9d5-ac895786d8e0" containerName="extract" Jun 14 03:21:43.473535 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.473484 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d500ca-8005-4f60-a9d5-ac895786d8e0" containerName="extract" Jun 14 03:21:43.473535 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.473512 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d500ca-8005-4f60-a9d5-ac895786d8e0" containerName="util" Jun 14 03:21:43.473535 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.473521 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d500ca-8005-4f60-a9d5-ac895786d8e0" containerName="util" Jun 14 03:21:43.473760 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.473607 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5d500ca-8005-4f60-a9d5-ac895786d8e0" containerName="extract" Jun 14 03:21:43.477707 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.477681 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.479902 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.479878 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 14 03:21:43.480054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.480032 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 14 03:21:43.480126 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.480115 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5qmn7\"" Jun 14 03:21:43.480186 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.480144 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 14 03:21:43.480186 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.480112 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 14 03:21:43.483787 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.483759 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:43.488969 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.488929 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj"] Jun 14 03:21:43.581397 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.581361 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:43.588352 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.588330 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.588456 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.588368 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.588456 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.588403 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.588456 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.588423 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.588580 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.588487 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.588580 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.588519 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhrj2\" (UniqueName: \"kubernetes.io/projected/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-kube-api-access-lhrj2\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.588580 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.588538 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.689138 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.689094 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.689138 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.689131 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.689394 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.689177 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.689394 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.689352 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhrj2\" (UniqueName: \"kubernetes.io/projected/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-kube-api-access-lhrj2\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.689515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.689395 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.689515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.689428 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.689515 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.689477 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.689854 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.689822 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.691605 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.691575 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.691734 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.691657 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.691794 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.691728 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.691967 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.691951 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.696425 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.696403 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.696643 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.696623 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhrj2\" (UniqueName: \"kubernetes.io/projected/278d4fd5-ca26-4eab-9b5d-18fee045c4cc-kube-api-access-lhrj2\") pod \"istiod-openshift-gateway-75c67f8887-drtzj\" (UID: \"278d4fd5-ca26-4eab-9b5d-18fee045c4cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.788082 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.788003 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:43.816075 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.816033 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:43.921019 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.920988 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:43.927088 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:43.927029 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj"] Jun 14 03:21:43.929306 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:21:43.929277 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278d4fd5_ca26_4eab_9b5d_18fee045c4cc.slice/crio-3ae9187c2952374308afb696d9d6208ba2cd6850d0b33b79b00faa26f905843e WatchSource:0}: Error finding container 3ae9187c2952374308afb696d9d6208ba2cd6850d0b33b79b00faa26f905843e: Status 404 returned error can't find the container with id 3ae9187c2952374308afb696d9d6208ba2cd6850d0b33b79b00faa26f905843e Jun 14 03:21:44.029538 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:44.029506 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:44.420505 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:44.420465 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" event={"ID":"278d4fd5-ca26-4eab-9b5d-18fee045c4cc","Type":"ContainerStarted","Data":"3ae9187c2952374308afb696d9d6208ba2cd6850d0b33b79b00faa26f905843e"} Jun 14 03:21:47.129696 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:47.129661 2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 03:21:47.129960 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:47.129728 2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 14 03:21:47.438154 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:47.438101 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" event={"ID":"278d4fd5-ca26-4eab-9b5d-18fee045c4cc","Type":"ContainerStarted","Data":"8f3c663c70d6f5ad29e91d446f3608294ee29353aa35f3b0482c80d98722bd01"} Jun 14 03:21:47.438536 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:47.438271 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:47.458260 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:47.458209 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" podStartSLOduration=1.260351846 podStartE2EDuration="4.458193499s" totalImagesPullingTime="3.197841653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:47.456879839 +0000 UTC m=+530.572494038" watchObservedRunningTime="2026-06-14 03:21:47.458193499 +0000 UTC m=+530.573807697" Jun 14 03:21:47.997419 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:47.997368 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:48.053034 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.053000 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:48.310550 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.310469 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:48.410757 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.410719 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:48.446460 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.446427 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-drtzj" Jun 14 03:21:48.533812 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.533765 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:48.733234 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.733168 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d54cc8554-bqkt4"] Jun 14 03:21:48.736773 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.736748 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" Jun 14 03:21:48.739356 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.739331 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 14 03:21:48.739460 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.739404 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4kshk\"" Jun 14 03:21:48.744705 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.744680 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d54cc8554-bqkt4"] Jun 14 03:21:48.764318 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.764286 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:21:48.830122 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.830081 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c104e6e6-2111-434a-ab2a-3ce03c515f42-redirect-config\") pod \"dashboard-redirect-6d54cc8554-bqkt4\" (UID: \"c104e6e6-2111-434a-ab2a-3ce03c515f42\") " pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" Jun 14 03:21:48.830305 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.830176 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjskn\" (UniqueName: \"kubernetes.io/projected/c104e6e6-2111-434a-ab2a-3ce03c515f42-kube-api-access-fjskn\") pod \"dashboard-redirect-6d54cc8554-bqkt4\" (UID: \"c104e6e6-2111-434a-ab2a-3ce03c515f42\") " pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" Jun 14 03:21:48.930622 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.930590 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjskn\" (UniqueName: \"kubernetes.io/projected/c104e6e6-2111-434a-ab2a-3ce03c515f42-kube-api-access-fjskn\") pod \"dashboard-redirect-6d54cc8554-bqkt4\" (UID: \"c104e6e6-2111-434a-ab2a-3ce03c515f42\") " pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" Jun 14 03:21:48.930785 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.930751 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c104e6e6-2111-434a-ab2a-3ce03c515f42-redirect-config\") pod \"dashboard-redirect-6d54cc8554-bqkt4\" (UID: \"c104e6e6-2111-434a-ab2a-3ce03c515f42\") " pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" Jun 14 03:21:48.931478 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.931457 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/c104e6e6-2111-434a-ab2a-3ce03c515f42-redirect-config\") pod \"dashboard-redirect-6d54cc8554-bqkt4\" (UID: \"c104e6e6-2111-434a-ab2a-3ce03c515f42\") " pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" Jun 14 03:21:48.938339 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:48.938313 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjskn\" (UniqueName: \"kubernetes.io/projected/c104e6e6-2111-434a-ab2a-3ce03c515f42-kube-api-access-fjskn\") pod \"dashboard-redirect-6d54cc8554-bqkt4\" (UID: \"c104e6e6-2111-434a-ab2a-3ce03c515f42\") " pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" Jun 14 03:21:49.050050 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:49.049966 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" Jun 14 03:21:49.186567 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:49.186508 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d54cc8554-bqkt4"] Jun 14 03:21:49.189110 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:21:49.189082 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc104e6e6_2111_434a_ab2a_3ce03c515f42.slice/crio-dfa600b2aba955c3d5447201fb9785187913fde43e1e09831bf3ddfe53cfabe2 WatchSource:0}: Error finding container dfa600b2aba955c3d5447201fb9785187913fde43e1e09831bf3ddfe53cfabe2: Status 404 returned error can't find the container with id dfa600b2aba955c3d5447201fb9785187913fde43e1e09831bf3ddfe53cfabe2 Jun 14 03:21:49.395308 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:49.395229 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-7rtr7" Jun 14 03:21:49.450538 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:49.450499 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" event={"ID":"c104e6e6-2111-434a-ab2a-3ce03c515f42","Type":"ContainerStarted","Data":"dfa600b2aba955c3d5447201fb9785187913fde43e1e09831bf3ddfe53cfabe2"} Jun 14 03:21:53.474477 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:53.474436 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" event={"ID":"c104e6e6-2111-434a-ab2a-3ce03c515f42","Type":"ContainerStarted","Data":"b54689e49bd840f41b79c2847efc8944f62c865d4d01eb5e06ddbc0bfcf14ee8"} Jun 14 03:21:53.490107 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:53.490061 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d54cc8554-bqkt4" podStartSLOduration=1.583436743 podStartE2EDuration="5.490047251s" totalImagesPullingTime="3.906610508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:21:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:21:53.489185879 +0000 UTC m=+536.604800081" watchObservedRunningTime="2026-06-14 03:21:53.490047251 +0000 UTC m=+536.605661449" Jun 14 03:21:59.341304 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:21:59.341271 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-nbmxx" Jun 14 03:22:00.333645 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:00.333614 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-586wr" Jun 14 03:22:15.585959 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:15.585928 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:15.642761 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:15.642728 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:15.751171 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:15.751135 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:16.508871 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:16.508811 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:16.713156 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:16.713118 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:31.324645 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.324614 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf"] Jun 14 03:22:31.338252 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.338226 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf"] Jun 14 03:22:31.338427 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.338357 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.341286 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.341262 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 03:22:31.341440 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.341333 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5gm2z\"" Jun 14 03:22:31.341440 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.341336 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 03:22:31.504924 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.504893 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.505104 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.504954 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.505104 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.504988 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7g44\" (UniqueName: \"kubernetes.io/projected/c95db13d-c905-4bb6-bf33-ef1fa705ec15-kube-api-access-z7g44\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.606343 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.606251 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.606343 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.606305 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.606343 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.606325 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7g44\" (UniqueName: \"kubernetes.io/projected/c95db13d-c905-4bb6-bf33-ef1fa705ec15-kube-api-access-z7g44\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.606686 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.606664 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.606686 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.606675 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.628054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.628023 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7g44\" (UniqueName: \"kubernetes.io/projected/c95db13d-c905-4bb6-bf33-ef1fa705ec15-kube-api-access-z7g44\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.650045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.650011 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:31.729650 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.729619 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg"] Jun 14 03:22:31.733855 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.733831 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:31.741960 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.741730 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg"] Jun 14 03:22:31.798021 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.797993 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf"] Jun 14 03:22:31.801308 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:22:31.801277 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95db13d_c905_4bb6_bf33_ef1fa705ec15.slice/crio-c390b009aeeb620a9f3438449338b46e077dcf0c2ae42de28ddfc5b92f9e976a WatchSource:0}: Error finding container c390b009aeeb620a9f3438449338b46e077dcf0c2ae42de28ddfc5b92f9e976a: Status 404 returned error can't find the container with id c390b009aeeb620a9f3438449338b46e077dcf0c2ae42de28ddfc5b92f9e976a Jun 14 03:22:31.909634 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.909607 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57j54\" (UniqueName: \"kubernetes.io/projected/771516e9-a9bd-4836-8270-d39dc1331178-kube-api-access-57j54\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:31.909775 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.909655 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:31.909775 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:31.909729 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:32.011139 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.011103 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:32.011139 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.011142 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:32.011381 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.011207 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57j54\" (UniqueName: \"kubernetes.io/projected/771516e9-a9bd-4836-8270-d39dc1331178-kube-api-access-57j54\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:32.011557 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.011532 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:32.011598 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.011567 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:32.020097 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.020072 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57j54\" (UniqueName: \"kubernetes.io/projected/771516e9-a9bd-4836-8270-d39dc1331178-kube-api-access-57j54\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:32.048015 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.047989 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:32.120365 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.120278 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd"] Jun 14 03:22:32.129546 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.129512 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.132183 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.132154 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd"] Jun 14 03:22:32.190992 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.190964 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg"] Jun 14 03:22:32.192603 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:22:32.192578 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771516e9_a9bd_4836_8270_d39dc1331178.slice/crio-a65848b896d223adde1a6f50e4802f3fe3659e9cd6ab2a674b525aec912c3f8f WatchSource:0}: Error finding container a65848b896d223adde1a6f50e4802f3fe3659e9cd6ab2a674b525aec912c3f8f: Status 404 returned error can't find the container with id a65848b896d223adde1a6f50e4802f3fe3659e9cd6ab2a674b525aec912c3f8f Jun 14 03:22:32.213671 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.213647 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssshc\" (UniqueName: \"kubernetes.io/projected/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-kube-api-access-ssshc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.213783 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.213694 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.213783 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.213723 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.314759 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.314722 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssshc\" (UniqueName: \"kubernetes.io/projected/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-kube-api-access-ssshc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.314759 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.314761 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.314960 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.314780 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.315191 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.315170 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.315224 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.315186 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.323209 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.323178 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssshc\" (UniqueName: \"kubernetes.io/projected/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-kube-api-access-ssshc\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.441664 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.441631 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:32.516232 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.516199 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q"] Jun 14 03:22:32.520084 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.520060 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.530672 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.530555 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q"] Jun 14 03:22:32.577283 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.577261 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd"] Jun 14 03:22:32.579142 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:22:32.579114 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb7a6ae_14d3_40bc_aae0_3a4199ffedf9.slice/crio-6fa522b89133eb9a3923f8370eb6916a5c10531e6038cf8b89b8a1b748669d0f WatchSource:0}: Error finding container 6fa522b89133eb9a3923f8370eb6916a5c10531e6038cf8b89b8a1b748669d0f: Status 404 returned error can't find the container with id 6fa522b89133eb9a3923f8370eb6916a5c10531e6038cf8b89b8a1b748669d0f Jun 14 03:22:32.617786 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.617760 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.617909 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.617818 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64kfb\" (UniqueName: \"kubernetes.io/projected/0be01209-c951-4583-9529-5dfd79a9beeb-kube-api-access-64kfb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.617975 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.617909 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.676301 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.676260 2547 generic.go:356] "Generic (PLEG): container finished" podID="c95db13d-c905-4bb6-bf33-ef1fa705ec15" containerID="bb47332bade70c02d291eafd08069eacf31ad8bc589ce144a8c93ebd9f26b24c" exitCode=0 Jun 14 03:22:32.676424 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.676326 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" event={"ID":"c95db13d-c905-4bb6-bf33-ef1fa705ec15","Type":"ContainerDied","Data":"bb47332bade70c02d291eafd08069eacf31ad8bc589ce144a8c93ebd9f26b24c"} Jun 14 03:22:32.676424 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.676388 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" event={"ID":"c95db13d-c905-4bb6-bf33-ef1fa705ec15","Type":"ContainerStarted","Data":"c390b009aeeb620a9f3438449338b46e077dcf0c2ae42de28ddfc5b92f9e976a"} Jun 14 03:22:32.678271 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.678245 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" event={"ID":"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9","Type":"ContainerStarted","Data":"da36295ab2b545c57a3ddd6305065bbb2f4aed5cee84b2a3df2315753f98c5fa"} Jun 14 03:22:32.678384 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.678291 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" event={"ID":"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9","Type":"ContainerStarted","Data":"6fa522b89133eb9a3923f8370eb6916a5c10531e6038cf8b89b8a1b748669d0f"} Jun 14 03:22:32.680069 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.680045 2547 generic.go:356] "Generic (PLEG): container finished" podID="771516e9-a9bd-4836-8270-d39dc1331178" containerID="3b83fc4db533e3d067ee928136883a2dd59edf799cbdbac4e559c94123fd4b37" exitCode=0 Jun 14 03:22:32.680165 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.680089 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" event={"ID":"771516e9-a9bd-4836-8270-d39dc1331178","Type":"ContainerDied","Data":"3b83fc4db533e3d067ee928136883a2dd59edf799cbdbac4e559c94123fd4b37"} Jun 14 03:22:32.680165 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.680126 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" event={"ID":"771516e9-a9bd-4836-8270-d39dc1331178","Type":"ContainerStarted","Data":"a65848b896d223adde1a6f50e4802f3fe3659e9cd6ab2a674b525aec912c3f8f"} Jun 14 03:22:32.718394 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.718310 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.718552 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.718390 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.718552 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.718433 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64kfb\" (UniqueName: \"kubernetes.io/projected/0be01209-c951-4583-9529-5dfd79a9beeb-kube-api-access-64kfb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.718706 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.718684 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.718765 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.718720 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.730325 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.730291 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64kfb\" (UniqueName: \"kubernetes.io/projected/0be01209-c951-4583-9529-5dfd79a9beeb-kube-api-access-64kfb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.833180 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.833145 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:32.981572 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:32.981549 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q"] Jun 14 03:22:32.983328 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:22:32.983298 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be01209_c951_4583_9529_5dfd79a9beeb.slice/crio-2c031943071091779ddf91d51d8c3bcb0e89c0fb94be98a8fdefeca944e9c404 WatchSource:0}: Error finding container 2c031943071091779ddf91d51d8c3bcb0e89c0fb94be98a8fdefeca944e9c404: Status 404 returned error can't find the container with id 2c031943071091779ddf91d51d8c3bcb0e89c0fb94be98a8fdefeca944e9c404 Jun 14 03:22:33.687819 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:33.687777 2547 generic.go:356] "Generic (PLEG): container finished" podID="abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" containerID="da36295ab2b545c57a3ddd6305065bbb2f4aed5cee84b2a3df2315753f98c5fa" exitCode=0 Jun 14 03:22:33.688229 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:33.687834 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" event={"ID":"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9","Type":"ContainerDied","Data":"da36295ab2b545c57a3ddd6305065bbb2f4aed5cee84b2a3df2315753f98c5fa"} Jun 14 03:22:33.689911 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:33.689889 2547 generic.go:356] "Generic (PLEG): container finished" podID="771516e9-a9bd-4836-8270-d39dc1331178" containerID="6945550b4b015c7ae87e1190e632cd0b844f1a62bef1298bb0a38d480d97060a" exitCode=0 Jun 14 03:22:33.690024 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:33.689997 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" event={"ID":"771516e9-a9bd-4836-8270-d39dc1331178","Type":"ContainerDied","Data":"6945550b4b015c7ae87e1190e632cd0b844f1a62bef1298bb0a38d480d97060a"} Jun 14 03:22:33.692036 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:33.692016 2547 generic.go:356] "Generic (PLEG): container finished" podID="c95db13d-c905-4bb6-bf33-ef1fa705ec15" containerID="7fb11eeb732140c502fcc28d23f8da362b408879153240162d3165bc58e2ae4e" exitCode=0 Jun 14 03:22:33.692122 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:33.692101 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" event={"ID":"c95db13d-c905-4bb6-bf33-ef1fa705ec15","Type":"ContainerDied","Data":"7fb11eeb732140c502fcc28d23f8da362b408879153240162d3165bc58e2ae4e"} Jun 14 03:22:33.693727 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:33.693711 2547 generic.go:356] "Generic (PLEG): container finished" podID="0be01209-c951-4583-9529-5dfd79a9beeb" containerID="eb5cbcee7bc9aec6ced403a346b71e7b9f5fe55c711ee787227d70e63285f320" exitCode=0 Jun 14 03:22:33.693822 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:33.693735 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" event={"ID":"0be01209-c951-4583-9529-5dfd79a9beeb","Type":"ContainerDied","Data":"eb5cbcee7bc9aec6ced403a346b71e7b9f5fe55c711ee787227d70e63285f320"} Jun 14 03:22:33.693822 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:33.693762 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" event={"ID":"0be01209-c951-4583-9529-5dfd79a9beeb","Type":"ContainerStarted","Data":"2c031943071091779ddf91d51d8c3bcb0e89c0fb94be98a8fdefeca944e9c404"} Jun 14 03:22:34.701289 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:34.701250 2547 generic.go:356] "Generic (PLEG): container finished" podID="abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" containerID="2c5a5304cab3f185d6e74cf36613374607ff0c98f53083deea0c377405942969" exitCode=0 Jun 14 03:22:34.701711 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:34.701331 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" event={"ID":"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9","Type":"ContainerDied","Data":"2c5a5304cab3f185d6e74cf36613374607ff0c98f53083deea0c377405942969"} Jun 14 03:22:34.703442 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:34.703423 2547 generic.go:356] "Generic (PLEG): container finished" podID="771516e9-a9bd-4836-8270-d39dc1331178" containerID="5fba882c4749643fbaa5cd1b2c96ddfb7237e2875c9c96f2fa320db3fbbf1058" exitCode=0 Jun 14 03:22:34.703548 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:34.703507 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" event={"ID":"771516e9-a9bd-4836-8270-d39dc1331178","Type":"ContainerDied","Data":"5fba882c4749643fbaa5cd1b2c96ddfb7237e2875c9c96f2fa320db3fbbf1058"} Jun 14 03:22:34.705625 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:34.705602 2547 generic.go:356] "Generic (PLEG): container finished" podID="c95db13d-c905-4bb6-bf33-ef1fa705ec15" containerID="a3721b58c05d3b4d141a363d7e1eaa1bbe10a557ed0cb8b49f1718f0a7fb149e" exitCode=0 Jun 14 03:22:34.705732 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:34.705639 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" event={"ID":"c95db13d-c905-4bb6-bf33-ef1fa705ec15","Type":"ContainerDied","Data":"a3721b58c05d3b4d141a363d7e1eaa1bbe10a557ed0cb8b49f1718f0a7fb149e"} Jun 14 03:22:34.707399 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:34.707381 2547 generic.go:356] "Generic (PLEG): container finished" podID="0be01209-c951-4583-9529-5dfd79a9beeb" containerID="1c06c4c9bfa903cff6f6fd66c1b31fdd184f87cdda2d3a8738b6bf4da10dfc5e" exitCode=0 Jun 14 03:22:34.707506 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:34.707431 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" event={"ID":"0be01209-c951-4583-9529-5dfd79a9beeb","Type":"ContainerDied","Data":"1c06c4c9bfa903cff6f6fd66c1b31fdd184f87cdda2d3a8738b6bf4da10dfc5e"} Jun 14 03:22:35.714121 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:35.714089 2547 generic.go:356] "Generic (PLEG): container finished" podID="abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" containerID="cee530fcf2cfa8096b66be8422f6b84e29206e5591a8c68dc015a9ba6c84c11b" exitCode=0 Jun 14 03:22:35.714501 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:35.714177 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" event={"ID":"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9","Type":"ContainerDied","Data":"cee530fcf2cfa8096b66be8422f6b84e29206e5591a8c68dc015a9ba6c84c11b"} Jun 14 03:22:35.716151 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:35.716127 2547 generic.go:356] "Generic (PLEG): container finished" podID="0be01209-c951-4583-9529-5dfd79a9beeb" containerID="b2314597da6983728de7b80db59224f6358ae8e91fd43d98803e0d762f9447fe" exitCode=0 Jun 14 03:22:35.716256 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:35.716209 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" event={"ID":"0be01209-c951-4583-9529-5dfd79a9beeb","Type":"ContainerDied","Data":"b2314597da6983728de7b80db59224f6358ae8e91fd43d98803e0d762f9447fe"} Jun 14 03:22:35.879772 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:35.879747 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:35.882609 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:35.882587 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:36.046472 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.046418 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7g44\" (UniqueName: \"kubernetes.io/projected/c95db13d-c905-4bb6-bf33-ef1fa705ec15-kube-api-access-z7g44\") pod \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " Jun 14 03:22:36.046654 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.046489 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-bundle\") pod \"771516e9-a9bd-4836-8270-d39dc1331178\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " Jun 14 03:22:36.046740 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.046652 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-bundle\") pod \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " Jun 14 03:22:36.046740 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.046699 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-util\") pod \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\" (UID: \"c95db13d-c905-4bb6-bf33-ef1fa705ec15\") " Jun 14 03:22:36.046891 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.046768 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-util\") pod \"771516e9-a9bd-4836-8270-d39dc1331178\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " Jun 14 03:22:36.046891 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.046837 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57j54\" (UniqueName: \"kubernetes.io/projected/771516e9-a9bd-4836-8270-d39dc1331178-kube-api-access-57j54\") pod \"771516e9-a9bd-4836-8270-d39dc1331178\" (UID: \"771516e9-a9bd-4836-8270-d39dc1331178\") " Jun 14 03:22:36.047234 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.047204 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-bundle" (OuterVolumeSpecName: "bundle") pod "771516e9-a9bd-4836-8270-d39dc1331178" (UID: "771516e9-a9bd-4836-8270-d39dc1331178"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:22:36.047407 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.047380 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-bundle" (OuterVolumeSpecName: "bundle") pod "c95db13d-c905-4bb6-bf33-ef1fa705ec15" (UID: "c95db13d-c905-4bb6-bf33-ef1fa705ec15"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:22:36.048833 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.048792 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c95db13d-c905-4bb6-bf33-ef1fa705ec15-kube-api-access-z7g44" (OuterVolumeSpecName: "kube-api-access-z7g44") pod "c95db13d-c905-4bb6-bf33-ef1fa705ec15" (UID: "c95db13d-c905-4bb6-bf33-ef1fa705ec15"). InnerVolumeSpecName "kube-api-access-z7g44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:22:36.049052 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.049033 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/771516e9-a9bd-4836-8270-d39dc1331178-kube-api-access-57j54" (OuterVolumeSpecName: "kube-api-access-57j54") pod "771516e9-a9bd-4836-8270-d39dc1331178" (UID: "771516e9-a9bd-4836-8270-d39dc1331178"). InnerVolumeSpecName "kube-api-access-57j54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:22:36.052129 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.052104 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-util" (OuterVolumeSpecName: "util") pod "c95db13d-c905-4bb6-bf33-ef1fa705ec15" (UID: "c95db13d-c905-4bb6-bf33-ef1fa705ec15"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:22:36.054037 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.054009 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-util" (OuterVolumeSpecName: "util") pod "771516e9-a9bd-4836-8270-d39dc1331178" (UID: "771516e9-a9bd-4836-8270-d39dc1331178"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:22:36.147562 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.147527 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-util\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:36.147562 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.147556 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-util\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:36.147758 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.147567 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57j54\" (UniqueName: \"kubernetes.io/projected/771516e9-a9bd-4836-8270-d39dc1331178-kube-api-access-57j54\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:36.147758 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.147588 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7g44\" (UniqueName: \"kubernetes.io/projected/c95db13d-c905-4bb6-bf33-ef1fa705ec15-kube-api-access-z7g44\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:36.147758 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.147599 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/771516e9-a9bd-4836-8270-d39dc1331178-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:36.147758 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.147607 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c95db13d-c905-4bb6-bf33-ef1fa705ec15-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:36.723896 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.723849 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" event={"ID":"c95db13d-c905-4bb6-bf33-ef1fa705ec15","Type":"ContainerDied","Data":"c390b009aeeb620a9f3438449338b46e077dcf0c2ae42de28ddfc5b92f9e976a"} Jun 14 03:22:36.723896 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.723880 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf" Jun 14 03:22:36.724428 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.723906 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c390b009aeeb620a9f3438449338b46e077dcf0c2ae42de28ddfc5b92f9e976a" Jun 14 03:22:36.725771 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.725734 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" event={"ID":"771516e9-a9bd-4836-8270-d39dc1331178","Type":"ContainerDied","Data":"a65848b896d223adde1a6f50e4802f3fe3659e9cd6ab2a674b525aec912c3f8f"} Jun 14 03:22:36.725897 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.725779 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a65848b896d223adde1a6f50e4802f3fe3659e9cd6ab2a674b525aec912c3f8f" Jun 14 03:22:36.725897 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.725742 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg" Jun 14 03:22:36.882111 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.882085 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:36.884370 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:36.884351 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:37.055103 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.055024 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-bundle\") pod \"0be01209-c951-4583-9529-5dfd79a9beeb\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " Jun 14 03:22:37.055103 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.055081 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64kfb\" (UniqueName: \"kubernetes.io/projected/0be01209-c951-4583-9529-5dfd79a9beeb-kube-api-access-64kfb\") pod \"0be01209-c951-4583-9529-5dfd79a9beeb\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " Jun 14 03:22:37.055103 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.055101 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-util\") pod \"0be01209-c951-4583-9529-5dfd79a9beeb\" (UID: \"0be01209-c951-4583-9529-5dfd79a9beeb\") " Jun 14 03:22:37.055376 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.055146 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-util\") pod \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " Jun 14 03:22:37.055376 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.055170 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssshc\" (UniqueName: \"kubernetes.io/projected/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-kube-api-access-ssshc\") pod \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " Jun 14 03:22:37.055376 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.055193 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-bundle\") pod \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\" (UID: \"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9\") " Jun 14 03:22:37.055825 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.055698 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-bundle" (OuterVolumeSpecName: "bundle") pod "0be01209-c951-4583-9529-5dfd79a9beeb" (UID: "0be01209-c951-4583-9529-5dfd79a9beeb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:22:37.055949 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.055923 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-bundle" (OuterVolumeSpecName: "bundle") pod "abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" (UID: "abb7a6ae-14d3-40bc-aae0-3a4199ffedf9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:22:37.057350 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.057325 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be01209-c951-4583-9529-5dfd79a9beeb-kube-api-access-64kfb" (OuterVolumeSpecName: "kube-api-access-64kfb") pod "0be01209-c951-4583-9529-5dfd79a9beeb" (UID: "0be01209-c951-4583-9529-5dfd79a9beeb"). InnerVolumeSpecName "kube-api-access-64kfb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:22:37.057440 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.057373 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-kube-api-access-ssshc" (OuterVolumeSpecName: "kube-api-access-ssshc") pod "abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" (UID: "abb7a6ae-14d3-40bc-aae0-3a4199ffedf9"). InnerVolumeSpecName "kube-api-access-ssshc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:22:37.060795 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.060760 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-util" (OuterVolumeSpecName: "util") pod "0be01209-c951-4583-9529-5dfd79a9beeb" (UID: "0be01209-c951-4583-9529-5dfd79a9beeb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:22:37.061036 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.061016 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-util" (OuterVolumeSpecName: "util") pod "abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" (UID: "abb7a6ae-14d3-40bc-aae0-3a4199ffedf9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:22:37.156016 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.155970 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64kfb\" (UniqueName: \"kubernetes.io/projected/0be01209-c951-4583-9529-5dfd79a9beeb-kube-api-access-64kfb\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:37.156016 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.156003 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-util\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:37.156016 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.156014 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-util\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:37.156016 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.156022 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssshc\" (UniqueName: \"kubernetes.io/projected/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-kube-api-access-ssshc\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:37.156271 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.156031 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb7a6ae-14d3-40bc-aae0-3a4199ffedf9-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:37.156271 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.156040 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0be01209-c951-4583-9529-5dfd79a9beeb-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:22:37.732944 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.732913 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" Jun 14 03:22:37.732944 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.732926 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd" event={"ID":"abb7a6ae-14d3-40bc-aae0-3a4199ffedf9","Type":"ContainerDied","Data":"6fa522b89133eb9a3923f8370eb6916a5c10531e6038cf8b89b8a1b748669d0f"} Jun 14 03:22:37.733390 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.732973 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fa522b89133eb9a3923f8370eb6916a5c10531e6038cf8b89b8a1b748669d0f" Jun 14 03:22:37.734993 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.734959 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" event={"ID":"0be01209-c951-4583-9529-5dfd79a9beeb","Type":"ContainerDied","Data":"2c031943071091779ddf91d51d8c3bcb0e89c0fb94be98a8fdefeca944e9c404"} Jun 14 03:22:37.734993 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.734983 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q" Jun 14 03:22:37.735192 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:37.734999 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c031943071091779ddf91d51d8c3bcb0e89c0fb94be98a8fdefeca944e9c404" Jun 14 03:22:44.068585 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:44.068554 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:47.519006 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:47.518968 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:49.147850 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:49.147791 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:49.513539 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:49.513501 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:51.330324 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:51.330287 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:51.493136 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:51.493101 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:53.737522 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:53.737483 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:53.889685 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:53.889651 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:54.688961 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:54.688922 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:56.100699 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:56.100664 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:56.199268 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:56.199226 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:57.099286 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099249 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5"] Jun 14 03:22:57.099594 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099581 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be01209-c951-4583-9529-5dfd79a9beeb" containerName="pull" Jun 14 03:22:57.099652 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099596 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be01209-c951-4583-9529-5dfd79a9beeb" containerName="pull" Jun 14 03:22:57.099652 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099609 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be01209-c951-4583-9529-5dfd79a9beeb" containerName="extract" Jun 14 03:22:57.099652 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099614 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be01209-c951-4583-9529-5dfd79a9beeb" containerName="extract" Jun 14 03:22:57.099652 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099623 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="771516e9-a9bd-4836-8270-d39dc1331178" containerName="extract" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099629 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="771516e9-a9bd-4836-8270-d39dc1331178" containerName="extract" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099675 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95db13d-c905-4bb6-bf33-ef1fa705ec15" containerName="util" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099680 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95db13d-c905-4bb6-bf33-ef1fa705ec15" containerName="util" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099688 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" containerName="pull" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099692 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" containerName="pull" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099697 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" containerName="extract" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099713 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" containerName="extract" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099722 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="771516e9-a9bd-4836-8270-d39dc1331178" containerName="pull" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099727 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="771516e9-a9bd-4836-8270-d39dc1331178" containerName="pull" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099734 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be01209-c951-4583-9529-5dfd79a9beeb" containerName="util" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099739 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be01209-c951-4583-9529-5dfd79a9beeb" containerName="util" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099747 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" containerName="util" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099753 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" containerName="util" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099759 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95db13d-c905-4bb6-bf33-ef1fa705ec15" containerName="extract" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099764 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95db13d-c905-4bb6-bf33-ef1fa705ec15" containerName="extract" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099770 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="771516e9-a9bd-4836-8270-d39dc1331178" containerName="util" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099775 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="771516e9-a9bd-4836-8270-d39dc1331178" containerName="util" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099780 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95db13d-c905-4bb6-bf33-ef1fa705ec15" containerName="pull" Jun 14 03:22:57.099815 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099785 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95db13d-c905-4bb6-bf33-ef1fa705ec15" containerName="pull" Jun 14 03:22:57.100520 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099854 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be01209-c951-4583-9529-5dfd79a9beeb" containerName="extract" Jun 14 03:22:57.100520 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099863 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb7a6ae-14d3-40bc-aae0-3a4199ffedf9" containerName="extract" Jun 14 03:22:57.100520 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099870 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="771516e9-a9bd-4836-8270-d39dc1331178" containerName="extract" Jun 14 03:22:57.100520 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.099878 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c95db13d-c905-4bb6-bf33-ef1fa705ec15" containerName="extract" Jun 14 03:22:57.104550 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.104530 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5" Jun 14 03:22:57.106990 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.106969 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-49xgs\"" Jun 14 03:22:57.107950 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.107931 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 03:22:57.108022 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.107949 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 03:22:57.124156 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.124132 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5"] Jun 14 03:22:57.229620 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.229586 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9nlf\" (UniqueName: \"kubernetes.io/projected/14b3b628-845f-4f2a-bac5-5e205ad3a985-kube-api-access-t9nlf\") pod \"authorino-operator-75cc8d5cb7-m7cs5\" (UID: \"14b3b628-845f-4f2a-bac5-5e205ad3a985\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5" Jun 14 03:22:57.330073 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.330039 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9nlf\" (UniqueName: \"kubernetes.io/projected/14b3b628-845f-4f2a-bac5-5e205ad3a985-kube-api-access-t9nlf\") pod \"authorino-operator-75cc8d5cb7-m7cs5\" (UID: \"14b3b628-845f-4f2a-bac5-5e205ad3a985\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5" Jun 14 03:22:57.334294 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.334267 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:22:57.334769 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.334752 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:22:57.337844 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.337821 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 03:22:57.349442 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.349384 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 03:22:57.359486 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.359466 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9nlf\" (UniqueName: \"kubernetes.io/projected/14b3b628-845f-4f2a-bac5-5e205ad3a985-kube-api-access-t9nlf\") pod \"authorino-operator-75cc8d5cb7-m7cs5\" (UID: \"14b3b628-845f-4f2a-bac5-5e205ad3a985\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5" Jun 14 03:22:57.417330 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.417299 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-49xgs\"" Jun 14 03:22:57.425215 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.425190 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5" Jun 14 03:22:57.560720 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.560698 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5"] Jun 14 03:22:57.562643 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:22:57.562617 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b3b628_845f_4f2a_bac5_5e205ad3a985.slice/crio-6ce330c351fe6173e747d83b8aca69717238d20f925992bd4bf9fdbbcdeae425 WatchSource:0}: Error finding container 6ce330c351fe6173e747d83b8aca69717238d20f925992bd4bf9fdbbcdeae425: Status 404 returned error can't find the container with id 6ce330c351fe6173e747d83b8aca69717238d20f925992bd4bf9fdbbcdeae425 Jun 14 03:22:57.844247 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:57.844212 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5" event={"ID":"14b3b628-845f-4f2a-bac5-5e205ad3a985","Type":"ContainerStarted","Data":"6ce330c351fe6173e747d83b8aca69717238d20f925992bd4bf9fdbbcdeae425"} Jun 14 03:22:59.081214 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:59.081175 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:59.185220 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:59.185187 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:59.282015 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:59.281932 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:59.354467 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:59.354379 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:59.413790 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:59.413757 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:22:59.858919 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:59.858883 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5" event={"ID":"14b3b628-845f-4f2a-bac5-5e205ad3a985","Type":"ContainerStarted","Data":"b56694e52fafee510eddaa27711392370a30c6e6c906a4829eb2e912535c16d2"} Jun 14 03:22:59.859096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:59.858977 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5" Jun 14 03:22:59.879256 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:22:59.879211 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5" podStartSLOduration=0.718734084 podStartE2EDuration="2.879192241s" totalImagesPullingTime="2.160458157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:22:59.877724263 +0000 UTC m=+602.993338466" watchObservedRunningTime="2026-06-14 03:22:59.879192241 +0000 UTC m=+602.994806498" Jun 14 03:23:00.024790 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:00.024705 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:00.135479 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:00.135447 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:01.016709 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:01.016675 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:01.487470 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:01.487438 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:06.736960 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:06.736902 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:06.836773 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:06.836739 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:10.658730 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.658692 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn"] Jun 14 03:23:10.663709 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.663687 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:10.667096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.667075 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6nm8r\"" Jun 14 03:23:10.676355 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.676326 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn"] Jun 14 03:23:10.734736 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.734682 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:10.753545 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.753511 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dfhc\" (UniqueName: \"kubernetes.io/projected/4d38f29b-90fa-4184-9d24-45c2fad09ff9-kube-api-access-8dfhc\") pod \"kuadrant-operator-controller-manager-55467d9f7-mqjwn\" (UID: \"4d38f29b-90fa-4184-9d24-45c2fad09ff9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:10.753705 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.753572 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d38f29b-90fa-4184-9d24-45c2fad09ff9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mqjwn\" (UID: \"4d38f29b-90fa-4184-9d24-45c2fad09ff9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:10.837001 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.836959 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:10.854099 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.854068 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d38f29b-90fa-4184-9d24-45c2fad09ff9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mqjwn\" (UID: \"4d38f29b-90fa-4184-9d24-45c2fad09ff9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:10.854226 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.854182 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dfhc\" (UniqueName: \"kubernetes.io/projected/4d38f29b-90fa-4184-9d24-45c2fad09ff9-kube-api-access-8dfhc\") pod \"kuadrant-operator-controller-manager-55467d9f7-mqjwn\" (UID: \"4d38f29b-90fa-4184-9d24-45c2fad09ff9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:10.854501 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.854476 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d38f29b-90fa-4184-9d24-45c2fad09ff9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mqjwn\" (UID: \"4d38f29b-90fa-4184-9d24-45c2fad09ff9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:10.862564 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.862539 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dfhc\" (UniqueName: \"kubernetes.io/projected/4d38f29b-90fa-4184-9d24-45c2fad09ff9-kube-api-access-8dfhc\") pod \"kuadrant-operator-controller-manager-55467d9f7-mqjwn\" (UID: \"4d38f29b-90fa-4184-9d24-45c2fad09ff9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:10.867286 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.867258 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m7cs5" Jun 14 03:23:10.931229 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.931110 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:10.973941 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:10.973902 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:11.074184 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.074115 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn"] Jun 14 03:23:11.085378 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.085343 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn"] Jun 14 03:23:11.096794 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.096755 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9"] Jun 14 03:23:11.101609 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.101584 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:11.113234 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.113203 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9"] Jun 14 03:23:11.258117 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.258073 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldhr4\" (UniqueName: \"kubernetes.io/projected/a1f36376-6132-4d5a-8d32-5533acf958c2-kube-api-access-ldhr4\") pod \"kuadrant-operator-controller-manager-55467d9f7-t4ld9\" (UID: \"a1f36376-6132-4d5a-8d32-5533acf958c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:11.258282 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.258162 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1f36376-6132-4d5a-8d32-5533acf958c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-t4ld9\" (UID: \"a1f36376-6132-4d5a-8d32-5533acf958c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:11.288966 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:23:11.288869 2547 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 14 03:23:11.288966 ip-10-0-137-82 kubenswrapper[2547]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-mqjwn_kuadrant-system_4d38f29b-90fa-4184-9d24-45c2fad09ff9_0(0cd0323f5485b42fd577fa1ff55e3f3fdf8a77f6b3f9b06b577af54ea72f7598): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-mqjwn to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0cd0323f5485b42fd577fa1ff55e3f3fdf8a77f6b3f9b06b577af54ea72f7598" Netns:"/var/run/netns/ceaa0b0b-72c6-4516-93cf-bfccaaa37464" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-mqjwn;K8S_POD_INFRA_CONTAINER_ID=0cd0323f5485b42fd577fa1ff55e3f3fdf8a77f6b3f9b06b577af54ea72f7598;K8S_POD_UID=4d38f29b-90fa-4184-9d24-45c2fad09ff9" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn/4d38f29b-90fa-4184-9d24-45c2fad09ff9:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn 0cd0323f5485b42fd577fa1ff55e3f3fdf8a77f6b3f9b06b577af54ea72f7598 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn 0cd0323f5485b42fd577fa1ff55e3f3fdf8a77f6b3f9b06b577af54ea72f7598 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:2a [10.133.0.42/23] Jun 14 03:23:11.288966 ip-10-0-137-82 kubenswrapper[2547]: ' Jun 14 03:23:11.288966 ip-10-0-137-82 kubenswrapper[2547]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 14 03:23:11.288966 ip-10-0-137-82 kubenswrapper[2547]: > Jun 14 03:23:11.288966 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:23:11.288947 2547 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 14 03:23:11.288966 ip-10-0-137-82 kubenswrapper[2547]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-mqjwn_kuadrant-system_4d38f29b-90fa-4184-9d24-45c2fad09ff9_0(0cd0323f5485b42fd577fa1ff55e3f3fdf8a77f6b3f9b06b577af54ea72f7598): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-mqjwn to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"0cd0323f5485b42fd577fa1ff55e3f3fdf8a77f6b3f9b06b577af54ea72f7598" Netns:"/var/run/netns/ceaa0b0b-72c6-4516-93cf-bfccaaa37464" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-mqjwn;K8S_POD_INFRA_CONTAINER_ID=0cd0323f5485b42fd577fa1ff55e3f3fdf8a77f6b3f9b06b577af54ea72f7598;K8S_POD_UID=4d38f29b-90fa-4184-9d24-45c2fad09ff9" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn/4d38f29b-90fa-4184-9d24-45c2fad09ff9:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn 0cd0323f5485b42fd577fa1ff55e3f3fdf8a77f6b3f9b06b577af54ea72f7598 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn 0cd0323f5485b42fd577fa1ff55e3f3fdf8a77f6b3f9b06b577af54ea72f7598 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:2a [10.133.0.42/23] Jun 14 03:23:11.288966 ip-10-0-137-82 kubenswrapper[2547]: ' Jun 14 03:23:11.288966 ip-10-0-137-82 kubenswrapper[2547]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 14 03:23:11.288966 ip-10-0-137-82 kubenswrapper[2547]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:11.358860 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.358824 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldhr4\" (UniqueName: \"kubernetes.io/projected/a1f36376-6132-4d5a-8d32-5533acf958c2-kube-api-access-ldhr4\") pod \"kuadrant-operator-controller-manager-55467d9f7-t4ld9\" (UID: \"a1f36376-6132-4d5a-8d32-5533acf958c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:11.359043 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.358887 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1f36376-6132-4d5a-8d32-5533acf958c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-t4ld9\" (UID: \"a1f36376-6132-4d5a-8d32-5533acf958c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:11.359238 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.359222 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1f36376-6132-4d5a-8d32-5533acf958c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-t4ld9\" (UID: \"a1f36376-6132-4d5a-8d32-5533acf958c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:11.392925 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.392892 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldhr4\" (UniqueName: \"kubernetes.io/projected/a1f36376-6132-4d5a-8d32-5533acf958c2-kube-api-access-ldhr4\") pod \"kuadrant-operator-controller-manager-55467d9f7-t4ld9\" (UID: \"a1f36376-6132-4d5a-8d32-5533acf958c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:11.414724 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.414682 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:11.567642 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.567616 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9"] Jun 14 03:23:11.569379 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:23:11.569349 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f36376_6132_4d5a_8d32_5533acf958c2.slice/crio-b1d58e126417b2c137c60261710e2210dc5a323355151175a492408b2fe53a76 WatchSource:0}: Error finding container b1d58e126417b2c137c60261710e2210dc5a323355151175a492408b2fe53a76: Status 404 returned error can't find the container with id b1d58e126417b2c137c60261710e2210dc5a323355151175a492408b2fe53a76 Jun 14 03:23:11.571907 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.571892 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 03:23:11.573171 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.573148 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:11.667615 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.667579 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:11.925620 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.925584 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" event={"ID":"a1f36376-6132-4d5a-8d32-5533acf958c2","Type":"ContainerStarted","Data":"b1d58e126417b2c137c60261710e2210dc5a323355151175a492408b2fe53a76"} Jun 14 03:23:11.925620 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.925617 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:11.933776 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:11.933756 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:11.936417 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:23:11.936387 2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-mqjwn\" is forbidden: User \"system:node:ip-10-0-137-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-82.ec2.internal' and this object" podUID="4d38f29b-90fa-4184-9d24-45c2fad09ff9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:12.064357 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:12.064327 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d38f29b-90fa-4184-9d24-45c2fad09ff9-extensions-socket-volume\") pod \"4d38f29b-90fa-4184-9d24-45c2fad09ff9\" (UID: \"4d38f29b-90fa-4184-9d24-45c2fad09ff9\") " Jun 14 03:23:12.064544 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:12.064421 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dfhc\" (UniqueName: \"kubernetes.io/projected/4d38f29b-90fa-4184-9d24-45c2fad09ff9-kube-api-access-8dfhc\") pod \"4d38f29b-90fa-4184-9d24-45c2fad09ff9\" (UID: \"4d38f29b-90fa-4184-9d24-45c2fad09ff9\") " Jun 14 03:23:12.064643 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:12.064617 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d38f29b-90fa-4184-9d24-45c2fad09ff9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4d38f29b-90fa-4184-9d24-45c2fad09ff9" (UID: "4d38f29b-90fa-4184-9d24-45c2fad09ff9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:23:12.066438 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:12.066404 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d38f29b-90fa-4184-9d24-45c2fad09ff9-kube-api-access-8dfhc" (OuterVolumeSpecName: "kube-api-access-8dfhc") pod "4d38f29b-90fa-4184-9d24-45c2fad09ff9" (UID: "4d38f29b-90fa-4184-9d24-45c2fad09ff9"). InnerVolumeSpecName "kube-api-access-8dfhc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:23:12.166061 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:12.166024 2547 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4d38f29b-90fa-4184-9d24-45c2fad09ff9-extensions-socket-volume\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:23:12.166061 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:12.166061 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dfhc\" (UniqueName: \"kubernetes.io/projected/4d38f29b-90fa-4184-9d24-45c2fad09ff9-kube-api-access-8dfhc\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:23:12.931424 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:12.931391 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:12.933792 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:23:12.933763 2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-mqjwn\" is forbidden: User \"system:node:ip-10-0-137-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-82.ec2.internal' and this object" podUID="4d38f29b-90fa-4184-9d24-45c2fad09ff9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:12.939052 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:23:12.939024 2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-mqjwn\" is forbidden: User \"system:node:ip-10-0-137-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-82.ec2.internal' and this object" podUID="4d38f29b-90fa-4184-9d24-45c2fad09ff9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mqjwn" Jun 14 03:23:13.340422 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:13.340333 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d38f29b-90fa-4184-9d24-45c2fad09ff9" path="/var/lib/kubelet/pods/4d38f29b-90fa-4184-9d24-45c2fad09ff9/volumes" Jun 14 03:23:16.306286 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:16.306233 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:16.405206 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:16.405145 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:18.970417 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:18.970374 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" event={"ID":"a1f36376-6132-4d5a-8d32-5533acf958c2","Type":"ContainerStarted","Data":"788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56"} Jun 14 03:23:18.970925 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:18.970523 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:18.995603 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:18.995547 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" podStartSLOduration=1.32509545 podStartE2EDuration="7.995529926s" totalImagesPullingTime="6.670434476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:18.992342231 +0000 UTC m=+622.107956430" watchObservedRunningTime="2026-06-14 03:23:18.995529926 +0000 UTC m=+622.111144125" Jun 14 03:23:20.303696 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:20.303657 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:20.359856 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:20.359780 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:28.302827 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:28.302769 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:28.366373 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:28.366335 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:29.978686 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:29.978656 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:32.505480 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:32.505444 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:32.611027 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:32.610998 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:37.288227 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:37.288183 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:37.335954 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:37.335920 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:37.686944 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:37.686914 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:37.787011 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:37.786977 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:42.674493 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:42.674453 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9"] Jun 14 03:23:42.674916 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:42.674658 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" podUID="a1f36376-6132-4d5a-8d32-5533acf958c2" containerName="manager" containerID="cri-o://788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56" gracePeriod=10 Jun 14 03:23:42.926531 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:42.926459 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:43.025093 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.025064 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1f36376-6132-4d5a-8d32-5533acf958c2-extensions-socket-volume\") pod \"a1f36376-6132-4d5a-8d32-5533acf958c2\" (UID: \"a1f36376-6132-4d5a-8d32-5533acf958c2\") " Jun 14 03:23:43.025270 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.025120 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldhr4\" (UniqueName: \"kubernetes.io/projected/a1f36376-6132-4d5a-8d32-5533acf958c2-kube-api-access-ldhr4\") pod \"a1f36376-6132-4d5a-8d32-5533acf958c2\" (UID: \"a1f36376-6132-4d5a-8d32-5533acf958c2\") " Jun 14 03:23:43.025619 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.025581 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1f36376-6132-4d5a-8d32-5533acf958c2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a1f36376-6132-4d5a-8d32-5533acf958c2" (UID: "a1f36376-6132-4d5a-8d32-5533acf958c2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:23:43.027176 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.027152 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1f36376-6132-4d5a-8d32-5533acf958c2-kube-api-access-ldhr4" (OuterVolumeSpecName: "kube-api-access-ldhr4") pod "a1f36376-6132-4d5a-8d32-5533acf958c2" (UID: "a1f36376-6132-4d5a-8d32-5533acf958c2"). InnerVolumeSpecName "kube-api-access-ldhr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:23:43.101700 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.101658 2547 generic.go:356] "Generic (PLEG): container finished" podID="a1f36376-6132-4d5a-8d32-5533acf958c2" containerID="788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56" exitCode=0 Jun 14 03:23:43.101864 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.101703 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" Jun 14 03:23:43.101864 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.101735 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" event={"ID":"a1f36376-6132-4d5a-8d32-5533acf958c2","Type":"ContainerDied","Data":"788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56"} Jun 14 03:23:43.101864 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.101785 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9" event={"ID":"a1f36376-6132-4d5a-8d32-5533acf958c2","Type":"ContainerDied","Data":"b1d58e126417b2c137c60261710e2210dc5a323355151175a492408b2fe53a76"} Jun 14 03:23:43.101864 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.101823 2547 scope.go:117] "RemoveContainer" containerID="788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56" Jun 14 03:23:43.112102 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.112087 2547 scope.go:117] "RemoveContainer" containerID="788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56" Jun 14 03:23:43.112371 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:23:43.112354 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56\": container with ID starting with 788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56 not found: ID does not exist" containerID="788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56" Jun 14 03:23:43.112420 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.112380 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56"} err="failed to get container status \"788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56\": rpc error: code = NotFound desc = could not find container \"788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56\": container with ID starting with 788073adc06ff6cc4cff487e1e067cb972222d8c11d1d822acaef5801fadee56 not found: ID does not exist" Jun 14 03:23:43.123700 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.123677 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9"] Jun 14 03:23:43.126115 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.126094 2547 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1f36376-6132-4d5a-8d32-5533acf958c2-extensions-socket-volume\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:23:43.126115 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.126116 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldhr4\" (UniqueName: \"kubernetes.io/projected/a1f36376-6132-4d5a-8d32-5533acf958c2-kube-api-access-ldhr4\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:23:43.130054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.130025 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-t4ld9"] Jun 14 03:23:43.340252 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:43.340178 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1f36376-6132-4d5a-8d32-5533acf958c2" path="/var/lib/kubelet/pods/a1f36376-6132-4d5a-8d32-5533acf958c2/volumes" Jun 14 03:23:46.353072 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:46.353026 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:46.556942 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:46.556909 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:48.692185 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:48.692135 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:48.805000 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:48.804949 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:48.858774 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:48.858743 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:49.105852 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.105758 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:23:49.106292 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.106268 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1f36376-6132-4d5a-8d32-5533acf958c2" containerName="manager" Jun 14 03:23:49.106292 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.106291 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1f36376-6132-4d5a-8d32-5533acf958c2" containerName="manager" Jun 14 03:23:49.106520 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.106423 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1f36376-6132-4d5a-8d32-5533acf958c2" containerName="manager" Jun 14 03:23:49.109428 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.109413 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" Jun 14 03:23:49.112012 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.111991 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 03:23:49.112108 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.111998 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5gm2z\"" Jun 14 03:23:49.119025 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.119000 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:23:49.155147 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.155112 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:23:49.178405 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.178370 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5phj\" (UniqueName: \"kubernetes.io/projected/f9a8f3d9-e296-4bf2-ac99-cd65067885c7-kube-api-access-q5phj\") pod \"limitador-limitador-54d6d988d5-v77t5\" (UID: \"f9a8f3d9-e296-4bf2-ac99-cd65067885c7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" Jun 14 03:23:49.178569 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.178453 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9a8f3d9-e296-4bf2-ac99-cd65067885c7-config-file\") pod \"limitador-limitador-54d6d988d5-v77t5\" (UID: \"f9a8f3d9-e296-4bf2-ac99-cd65067885c7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" Jun 14 03:23:49.279709 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.279672 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5phj\" (UniqueName: \"kubernetes.io/projected/f9a8f3d9-e296-4bf2-ac99-cd65067885c7-kube-api-access-q5phj\") pod \"limitador-limitador-54d6d988d5-v77t5\" (UID: \"f9a8f3d9-e296-4bf2-ac99-cd65067885c7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" Jun 14 03:23:49.279914 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.279724 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9a8f3d9-e296-4bf2-ac99-cd65067885c7-config-file\") pod \"limitador-limitador-54d6d988d5-v77t5\" (UID: \"f9a8f3d9-e296-4bf2-ac99-cd65067885c7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" Jun 14 03:23:49.280362 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.280344 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f9a8f3d9-e296-4bf2-ac99-cd65067885c7-config-file\") pod \"limitador-limitador-54d6d988d5-v77t5\" (UID: \"f9a8f3d9-e296-4bf2-ac99-cd65067885c7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" Jun 14 03:23:49.287960 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.287938 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5phj\" (UniqueName: \"kubernetes.io/projected/f9a8f3d9-e296-4bf2-ac99-cd65067885c7-kube-api-access-q5phj\") pod \"limitador-limitador-54d6d988d5-v77t5\" (UID: \"f9a8f3d9-e296-4bf2-ac99-cd65067885c7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" Jun 14 03:23:49.420945 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.420909 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" Jun 14 03:23:49.551534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.551497 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:49.559428 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.559406 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:23:49.561674 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:23:49.561648 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a8f3d9_e296_4bf2_ac99_cd65067885c7.slice/crio-d2910ae8f475a894ae77c1d4616c0f1b59e9e456f2dbc1726b81d41677b10fb4 WatchSource:0}: Error finding container d2910ae8f475a894ae77c1d4616c0f1b59e9e456f2dbc1726b81d41677b10fb4: Status 404 returned error can't find the container with id d2910ae8f475a894ae77c1d4616c0f1b59e9e456f2dbc1726b81d41677b10fb4 Jun 14 03:23:49.612453 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:49.612399 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:23:50.143873 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:50.143828 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" event={"ID":"f9a8f3d9-e296-4bf2-ac99-cd65067885c7","Type":"ContainerStarted","Data":"d2910ae8f475a894ae77c1d4616c0f1b59e9e456f2dbc1726b81d41677b10fb4"} Jun 14 03:23:53.163332 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:53.163299 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" event={"ID":"f9a8f3d9-e296-4bf2-ac99-cd65067885c7","Type":"ContainerStarted","Data":"2d9b394543768ce6d523d25b00bb7bf6d0dcf7d3152c86dc66782849322d54fa"} Jun 14 03:23:53.163703 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:53.163437 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" Jun 14 03:23:53.179477 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:23:53.179419 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" podStartSLOduration=1.348618049 podStartE2EDuration="4.179403341s" totalImagesPullingTime="2.830785292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:23:53.177017024 +0000 UTC m=+656.292631222" watchObservedRunningTime="2026-06-14 03:23:53.179403341 +0000 UTC m=+656.295017539" Jun 14 03:24:04.170677 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:04.170644 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-v77t5" Jun 14 03:24:10.277459 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:10.277427 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:24:20.202210 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:20.202174 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:24:20.303131 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:20.303080 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:24:20.452345 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:20.452261 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:24:22.595163 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.595127 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g"] Jun 14 03:24:22.603533 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.603499 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:22.605603 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.605578 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g"] Jun 14 03:24:22.606086 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.606065 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 03:24:22.606184 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.606105 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 03:24:22.607095 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.607069 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nsh4l\"" Jun 14 03:24:22.685999 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.685964 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:22.685999 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.685997 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:22.686211 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.686094 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl6mh\" (UniqueName: \"kubernetes.io/projected/d7780808-09c8-4ce5-afb4-403bbc72cc1d-kube-api-access-pl6mh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:22.787174 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.787131 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl6mh\" (UniqueName: \"kubernetes.io/projected/d7780808-09c8-4ce5-afb4-403bbc72cc1d-kube-api-access-pl6mh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:22.787369 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.787218 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:22.787369 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.787247 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:22.787617 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.787596 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:22.787691 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.787633 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:22.795359 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.795327 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl6mh\" (UniqueName: \"kubernetes.io/projected/d7780808-09c8-4ce5-afb4-403bbc72cc1d-kube-api-access-pl6mh\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:22.913480 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:22.913446 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:23.047193 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:23.047165 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g"] Jun 14 03:24:23.049062 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:24:23.049035 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7780808_09c8_4ce5_afb4_403bbc72cc1d.slice/crio-4c8e3aa0d5b4ace835bfe472ab0b453098dbe90bbfaf50c675513aafaf435482 WatchSource:0}: Error finding container 4c8e3aa0d5b4ace835bfe472ab0b453098dbe90bbfaf50c675513aafaf435482: Status 404 returned error can't find the container with id 4c8e3aa0d5b4ace835bfe472ab0b453098dbe90bbfaf50c675513aafaf435482 Jun 14 03:24:23.340054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:23.339962 2547 generic.go:356] "Generic (PLEG): container finished" podID="d7780808-09c8-4ce5-afb4-403bbc72cc1d" containerID="46a985539404e8f04de5184074b70e5efd87e06636c5ad25d3638da912781023" exitCode=0 Jun 14 03:24:23.340235 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:23.340040 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" event={"ID":"d7780808-09c8-4ce5-afb4-403bbc72cc1d","Type":"ContainerDied","Data":"46a985539404e8f04de5184074b70e5efd87e06636c5ad25d3638da912781023"} Jun 14 03:24:23.340235 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:23.340100 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" event={"ID":"d7780808-09c8-4ce5-afb4-403bbc72cc1d","Type":"ContainerStarted","Data":"4c8e3aa0d5b4ace835bfe472ab0b453098dbe90bbfaf50c675513aafaf435482"} Jun 14 03:24:24.347575 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:24.347536 2547 generic.go:356] "Generic (PLEG): container finished" podID="d7780808-09c8-4ce5-afb4-403bbc72cc1d" containerID="bcbd66706295b606a8dc18ef8fe069a8ca8321d72b520e127229fba84ea4c09a" exitCode=0 Jun 14 03:24:24.348051 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:24.347614 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" event={"ID":"d7780808-09c8-4ce5-afb4-403bbc72cc1d","Type":"ContainerDied","Data":"bcbd66706295b606a8dc18ef8fe069a8ca8321d72b520e127229fba84ea4c09a"} Jun 14 03:24:25.355010 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:25.354977 2547 generic.go:356] "Generic (PLEG): container finished" podID="d7780808-09c8-4ce5-afb4-403bbc72cc1d" containerID="52ed0e7757b011453f5eb9dd2257dbd4554977708f26c8d07899f126e8190f20" exitCode=0 Jun 14 03:24:25.355395 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:25.355037 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" event={"ID":"d7780808-09c8-4ce5-afb4-403bbc72cc1d","Type":"ContainerDied","Data":"52ed0e7757b011453f5eb9dd2257dbd4554977708f26c8d07899f126e8190f20"} Jun 14 03:24:26.494455 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:26.494427 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:26.520300 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:26.520268 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-bundle\") pod \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " Jun 14 03:24:26.520508 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:26.520319 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl6mh\" (UniqueName: \"kubernetes.io/projected/d7780808-09c8-4ce5-afb4-403bbc72cc1d-kube-api-access-pl6mh\") pod \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " Jun 14 03:24:26.520508 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:26.520382 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-util\") pod \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\" (UID: \"d7780808-09c8-4ce5-afb4-403bbc72cc1d\") " Jun 14 03:24:26.521007 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:26.520972 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-bundle" (OuterVolumeSpecName: "bundle") pod "d7780808-09c8-4ce5-afb4-403bbc72cc1d" (UID: "d7780808-09c8-4ce5-afb4-403bbc72cc1d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:24:26.522433 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:26.522397 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7780808-09c8-4ce5-afb4-403bbc72cc1d-kube-api-access-pl6mh" (OuterVolumeSpecName: "kube-api-access-pl6mh") pod "d7780808-09c8-4ce5-afb4-403bbc72cc1d" (UID: "d7780808-09c8-4ce5-afb4-403bbc72cc1d"). InnerVolumeSpecName "kube-api-access-pl6mh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:24:26.526175 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:26.526150 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-util" (OuterVolumeSpecName: "util") pod "d7780808-09c8-4ce5-afb4-403bbc72cc1d" (UID: "d7780808-09c8-4ce5-afb4-403bbc72cc1d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 03:24:26.621094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:26.621003 2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-bundle\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:24:26.621094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:26.621032 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl6mh\" (UniqueName: \"kubernetes.io/projected/d7780808-09c8-4ce5-afb4-403bbc72cc1d-kube-api-access-pl6mh\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:24:26.621094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:26.621044 2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d7780808-09c8-4ce5-afb4-403bbc72cc1d-util\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:24:27.367255 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:27.367226 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" Jun 14 03:24:27.367255 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:27.367244 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748cgx8g" event={"ID":"d7780808-09c8-4ce5-afb4-403bbc72cc1d","Type":"ContainerDied","Data":"4c8e3aa0d5b4ace835bfe472ab0b453098dbe90bbfaf50c675513aafaf435482"} Jun 14 03:24:27.367436 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:27.367290 2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c8e3aa0d5b4ace835bfe472ab0b453098dbe90bbfaf50c675513aafaf435482" Jun 14 03:24:45.327275 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:45.327237 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:24:45.426746 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:24:45.426709 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:15.824712 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:15.824672 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:16.377595 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:16.377557 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:18.862255 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:18.862207 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:18.962123 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:18.962088 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:21.682151 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.682112 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:21.698773 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.698737 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57bbffc654-x74lv"] Jun 14 03:25:21.699094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.699081 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7780808-09c8-4ce5-afb4-403bbc72cc1d" containerName="extract" Jun 14 03:25:21.699094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.699096 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7780808-09c8-4ce5-afb4-403bbc72cc1d" containerName="extract" Jun 14 03:25:21.699178 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.699105 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7780808-09c8-4ce5-afb4-403bbc72cc1d" containerName="pull" Jun 14 03:25:21.699178 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.699110 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7780808-09c8-4ce5-afb4-403bbc72cc1d" containerName="pull" Jun 14 03:25:21.699178 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.699119 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7780808-09c8-4ce5-afb4-403bbc72cc1d" containerName="util" Jun 14 03:25:21.699178 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.699124 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7780808-09c8-4ce5-afb4-403bbc72cc1d" containerName="util" Jun 14 03:25:21.699305 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.699207 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7780808-09c8-4ce5-afb4-403bbc72cc1d" containerName="extract" Jun 14 03:25:21.702138 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.702123 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:21.705230 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.705208 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 03:25:21.705427 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.705377 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 03:25:21.705553 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.705454 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kzmt7\"" Jun 14 03:25:21.718829 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.718788 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57bbffc654-x74lv"] Jun 14 03:25:21.784262 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.784223 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:21.814507 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.814475 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5n7v\" (UniqueName: \"kubernetes.io/projected/21c90280-1f6a-4343-8cec-ad22025bb66e-kube-api-access-s5n7v\") pod \"maas-controller-57bbffc654-x74lv\" (UID: \"21c90280-1f6a-4343-8cec-ad22025bb66e\") " pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:21.814651 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.814525 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c90280-1f6a-4343-8cec-ad22025bb66e-webhook-cert\") pod \"maas-controller-57bbffc654-x74lv\" (UID: \"21c90280-1f6a-4343-8cec-ad22025bb66e\") " pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:21.864025 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.863994 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:21.869851 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.869817 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8494c94465-fmrwz"] Jun 14 03:25:21.873523 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.873504 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:21.884709 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.884685 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8494c94465-fmrwz"] Jun 14 03:25:21.915034 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.915005 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5n7v\" (UniqueName: \"kubernetes.io/projected/21c90280-1f6a-4343-8cec-ad22025bb66e-kube-api-access-s5n7v\") pod \"maas-controller-57bbffc654-x74lv\" (UID: \"21c90280-1f6a-4343-8cec-ad22025bb66e\") " pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:21.915237 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.915042 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8qc6\" (UniqueName: \"kubernetes.io/projected/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-kube-api-access-x8qc6\") pod \"maas-controller-8494c94465-fmrwz\" (UID: \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\") " pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:21.915237 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.915097 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c90280-1f6a-4343-8cec-ad22025bb66e-webhook-cert\") pod \"maas-controller-57bbffc654-x74lv\" (UID: \"21c90280-1f6a-4343-8cec-ad22025bb66e\") " pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:21.915237 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.915132 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-webhook-cert\") pod \"maas-controller-8494c94465-fmrwz\" (UID: \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\") " pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:21.915380 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:25:21.915235 2547 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 14 03:25:21.915380 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:25:21.915307 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21c90280-1f6a-4343-8cec-ad22025bb66e-webhook-cert podName:21c90280-1f6a-4343-8cec-ad22025bb66e nodeName:}" failed. No retries permitted until 2026-06-14 03:25:22.415289292 +0000 UTC m=+745.530903469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/21c90280-1f6a-4343-8cec-ad22025bb66e-webhook-cert") pod "maas-controller-57bbffc654-x74lv" (UID: "21c90280-1f6a-4343-8cec-ad22025bb66e") : secret "maas-controller-webhook-cert" not found Jun 14 03:25:21.926084 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:21.926060 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5n7v\" (UniqueName: \"kubernetes.io/projected/21c90280-1f6a-4343-8cec-ad22025bb66e-kube-api-access-s5n7v\") pod \"maas-controller-57bbffc654-x74lv\" (UID: \"21c90280-1f6a-4343-8cec-ad22025bb66e\") " pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:22.016421 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.016324 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-webhook-cert\") pod \"maas-controller-8494c94465-fmrwz\" (UID: \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\") " pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:22.016421 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.016417 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8qc6\" (UniqueName: \"kubernetes.io/projected/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-kube-api-access-x8qc6\") pod \"maas-controller-8494c94465-fmrwz\" (UID: \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\") " pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:22.016618 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:25:22.016473 2547 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 14 03:25:22.016618 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:25:22.016536 2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-webhook-cert podName:2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e nodeName:}" failed. No retries permitted until 2026-06-14 03:25:22.516520513 +0000 UTC m=+745.632134690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-webhook-cert") pod "maas-controller-8494c94465-fmrwz" (UID: "2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e") : secret "maas-controller-webhook-cert" not found Jun 14 03:25:22.025935 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.025911 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8qc6\" (UniqueName: \"kubernetes.io/projected/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-kube-api-access-x8qc6\") pod \"maas-controller-8494c94465-fmrwz\" (UID: \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\") " pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:22.203910 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.203873 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:22.420207 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.420175 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c90280-1f6a-4343-8cec-ad22025bb66e-webhook-cert\") pod \"maas-controller-57bbffc654-x74lv\" (UID: \"21c90280-1f6a-4343-8cec-ad22025bb66e\") " pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:22.422700 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.422666 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c90280-1f6a-4343-8cec-ad22025bb66e-webhook-cert\") pod \"maas-controller-57bbffc654-x74lv\" (UID: \"21c90280-1f6a-4343-8cec-ad22025bb66e\") " pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:22.521244 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.521207 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-webhook-cert\") pod \"maas-controller-8494c94465-fmrwz\" (UID: \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\") " pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:22.523627 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.523604 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-webhook-cert\") pod \"maas-controller-8494c94465-fmrwz\" (UID: \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\") " pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:22.613352 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.613314 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:22.748232 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.748204 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57bbffc654-x74lv"] Jun 14 03:25:22.750051 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:25:22.750028 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c90280_1f6a_4343_8cec_ad22025bb66e.slice/crio-e35fe39479e43e3a1f55fae792a0fa19bb792d6f5e2fa8f2abaebdaa1edd8bcc WatchSource:0}: Error finding container e35fe39479e43e3a1f55fae792a0fa19bb792d6f5e2fa8f2abaebdaa1edd8bcc: Status 404 returned error can't find the container with id e35fe39479e43e3a1f55fae792a0fa19bb792d6f5e2fa8f2abaebdaa1edd8bcc Jun 14 03:25:22.784301 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.784268 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:22.916071 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:22.916044 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8494c94465-fmrwz"] Jun 14 03:25:22.917883 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:25:22.917859 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac0ddfa_4c2d_4801_a2bb_3c178f67c85e.slice/crio-6bc49304ee46999f0cf41e36cbc6466b30ce10ef3d856505b421066c5babb722 WatchSource:0}: Error finding container 6bc49304ee46999f0cf41e36cbc6466b30ce10ef3d856505b421066c5babb722: Status 404 returned error can't find the container with id 6bc49304ee46999f0cf41e36cbc6466b30ce10ef3d856505b421066c5babb722 Jun 14 03:25:23.681847 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:23.681776 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8494c94465-fmrwz" event={"ID":"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e","Type":"ContainerStarted","Data":"6bc49304ee46999f0cf41e36cbc6466b30ce10ef3d856505b421066c5babb722"} Jun 14 03:25:23.683575 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:23.683531 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57bbffc654-x74lv" event={"ID":"21c90280-1f6a-4343-8cec-ad22025bb66e","Type":"ContainerStarted","Data":"e35fe39479e43e3a1f55fae792a0fa19bb792d6f5e2fa8f2abaebdaa1edd8bcc"} Jun 14 03:25:24.921263 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:24.921219 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:25.009330 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:25.009238 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:25.697284 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:25.697253 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8494c94465-fmrwz" event={"ID":"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e","Type":"ContainerStarted","Data":"083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc"} Jun 14 03:25:25.697481 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:25.697357 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:25.698730 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:25.698705 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57bbffc654-x74lv" event={"ID":"21c90280-1f6a-4343-8cec-ad22025bb66e","Type":"ContainerStarted","Data":"a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd"} Jun 14 03:25:25.698848 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:25.698764 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:25.716606 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:25.716561 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8494c94465-fmrwz" podStartSLOduration=2.94864727 podStartE2EDuration="4.7165464s" totalImagesPullingTime="1.76789913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:25:25.714949203 +0000 UTC m=+748.830563414" watchObservedRunningTime="2026-06-14 03:25:25.7165464 +0000 UTC m=+748.832160599" Jun 14 03:25:25.733384 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:25.733340 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57bbffc654-x74lv" podStartSLOduration=2.801567738 podStartE2EDuration="4.733323304s" totalImagesPullingTime="1.931755566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:25:25.731396156 +0000 UTC m=+748.847010367" watchObservedRunningTime="2026-06-14 03:25:25.733323304 +0000 UTC m=+748.848937503" Jun 14 03:25:36.709737 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:36.709708 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:36.710210 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:36.709792 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:25:36.770102 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:36.770066 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57bbffc654-x74lv"] Jun 14 03:25:36.770325 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:36.770298 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-57bbffc654-x74lv" podUID="21c90280-1f6a-4343-8cec-ad22025bb66e" containerName="manager" containerID="cri-o://a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd" gracePeriod=30 Jun 14 03:25:37.019580 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.019556 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:37.158363 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.158330 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c90280-1f6a-4343-8cec-ad22025bb66e-webhook-cert\") pod \"21c90280-1f6a-4343-8cec-ad22025bb66e\" (UID: \"21c90280-1f6a-4343-8cec-ad22025bb66e\") " Jun 14 03:25:37.158562 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.158393 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5n7v\" (UniqueName: \"kubernetes.io/projected/21c90280-1f6a-4343-8cec-ad22025bb66e-kube-api-access-s5n7v\") pod \"21c90280-1f6a-4343-8cec-ad22025bb66e\" (UID: \"21c90280-1f6a-4343-8cec-ad22025bb66e\") " Jun 14 03:25:37.160560 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.160528 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21c90280-1f6a-4343-8cec-ad22025bb66e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "21c90280-1f6a-4343-8cec-ad22025bb66e" (UID: "21c90280-1f6a-4343-8cec-ad22025bb66e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:25:37.160560 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.160534 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c90280-1f6a-4343-8cec-ad22025bb66e-kube-api-access-s5n7v" (OuterVolumeSpecName: "kube-api-access-s5n7v") pod "21c90280-1f6a-4343-8cec-ad22025bb66e" (UID: "21c90280-1f6a-4343-8cec-ad22025bb66e"). InnerVolumeSpecName "kube-api-access-s5n7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:25:37.259995 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.259918 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5n7v\" (UniqueName: \"kubernetes.io/projected/21c90280-1f6a-4343-8cec-ad22025bb66e-kube-api-access-s5n7v\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:25:37.259995 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.259944 2547 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21c90280-1f6a-4343-8cec-ad22025bb66e-webhook-cert\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:25:37.765566 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.765529 2547 generic.go:356] "Generic (PLEG): container finished" podID="21c90280-1f6a-4343-8cec-ad22025bb66e" containerID="a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd" exitCode=0 Jun 14 03:25:37.765962 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.765570 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57bbffc654-x74lv" Jun 14 03:25:37.765962 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.765595 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57bbffc654-x74lv" event={"ID":"21c90280-1f6a-4343-8cec-ad22025bb66e","Type":"ContainerDied","Data":"a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd"} Jun 14 03:25:37.765962 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.765642 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57bbffc654-x74lv" event={"ID":"21c90280-1f6a-4343-8cec-ad22025bb66e","Type":"ContainerDied","Data":"e35fe39479e43e3a1f55fae792a0fa19bb792d6f5e2fa8f2abaebdaa1edd8bcc"} Jun 14 03:25:37.765962 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.765670 2547 scope.go:117] "RemoveContainer" containerID="a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd" Jun 14 03:25:37.775000 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.774680 2547 scope.go:117] "RemoveContainer" containerID="a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd" Jun 14 03:25:37.775072 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:25:37.775003 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd\": container with ID starting with a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd not found: ID does not exist" containerID="a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd" Jun 14 03:25:37.775072 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.775028 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd"} err="failed to get container status \"a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd\": rpc error: code = NotFound desc = could not find container \"a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd\": container with ID starting with a4910a7a6b878d03fb63d7613e8f2916e9c69cdd09feb90b0f4f995a2492abdd not found: ID does not exist" Jun 14 03:25:37.784061 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.784033 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57bbffc654-x74lv"] Jun 14 03:25:37.786296 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:37.786275 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57bbffc654-x74lv"] Jun 14 03:25:39.340775 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:39.340745 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21c90280-1f6a-4343-8cec-ad22025bb66e" path="/var/lib/kubelet/pods/21c90280-1f6a-4343-8cec-ad22025bb66e/volumes" Jun 14 03:25:45.953568 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:45.953527 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:46.005523 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:46.005494 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:55.850320 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:55.850267 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:56.210416 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:56.210382 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:56.310236 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:56.310187 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:56.377758 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:56.377727 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:25:56.440677 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:25:56.440636 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:26:06.557361 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:26:06.557325 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:26:48.250308 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:26:48.250276 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:26:48.350660 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:26:48.350624 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:27:00.536420 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:00.536386 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:27:01.020037 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:01.019997 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:27:09.594970 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.594934 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss"] Jun 14 03:27:09.595452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.595285 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c90280-1f6a-4343-8cec-ad22025bb66e" containerName="manager" Jun 14 03:27:09.595452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.595297 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c90280-1f6a-4343-8cec-ad22025bb66e" containerName="manager" Jun 14 03:27:09.595452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.595372 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c90280-1f6a-4343-8cec-ad22025bb66e" containerName="manager" Jun 14 03:27:09.598613 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.598597 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.602131 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.602107 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 14 03:27:09.602131 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.602120 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dbmmh\"" Jun 14 03:27:09.602333 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.602148 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 03:27:09.602333 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.602151 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 03:27:09.607443 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.607419 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss"] Jun 14 03:27:09.612967 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.612942 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:27:09.749793 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.749758 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.749793 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.749796 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6lw2\" (UniqueName: \"kubernetes.io/projected/03023aa1-a984-47aa-a18c-743404bfc5c0-kube-api-access-c6lw2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.750029 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.749886 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.750029 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.749915 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.750029 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.749951 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03023aa1-a984-47aa-a18c-743404bfc5c0-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.750029 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.750003 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.851304 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.851217 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.851304 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.851273 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.851304 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.851296 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6lw2\" (UniqueName: \"kubernetes.io/projected/03023aa1-a984-47aa-a18c-743404bfc5c0-kube-api-access-c6lw2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.851576 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.851327 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.851576 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.851347 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.851576 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.851377 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03023aa1-a984-47aa-a18c-743404bfc5c0-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.851742 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.851706 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.851742 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.851721 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.851873 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.851856 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.853620 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.853589 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03023aa1-a984-47aa-a18c-743404bfc5c0-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.853849 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.853831 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03023aa1-a984-47aa-a18c-743404bfc5c0-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.859185 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.859161 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6lw2\" (UniqueName: \"kubernetes.io/projected/03023aa1-a984-47aa-a18c-743404bfc5c0-kube-api-access-c6lw2\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-zp8ss\" (UID: \"03023aa1-a984-47aa-a18c-743404bfc5c0\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:09.910276 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:09.910226 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:27:10.055911 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:10.055886 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss"] Jun 14 03:27:10.057473 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:27:10.057446 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03023aa1_a984_47aa_a18c_743404bfc5c0.slice/crio-e2cdb33d439af6a09263cd1d37f0dbd3309f4b710ef6bedb4da9ca72944358d4 WatchSource:0}: Error finding container e2cdb33d439af6a09263cd1d37f0dbd3309f4b710ef6bedb4da9ca72944358d4: Status 404 returned error can't find the container with id e2cdb33d439af6a09263cd1d37f0dbd3309f4b710ef6bedb4da9ca72944358d4 Jun 14 03:27:10.285186 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:10.285143 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" event={"ID":"03023aa1-a984-47aa-a18c-743404bfc5c0","Type":"ContainerStarted","Data":"e2cdb33d439af6a09263cd1d37f0dbd3309f4b710ef6bedb4da9ca72944358d4"} Jun 14 03:27:10.324788 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:10.324745 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:27:13.306621 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:13.306527 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" event={"ID":"03023aa1-a984-47aa-a18c-743404bfc5c0","Type":"ContainerStarted","Data":"c1f7e59848dbbcdeac501c85d9e0dc04eb25576375ada925dda0f1ef2270a120"} Jun 14 03:27:20.327286 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:20.327252 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:27:21.228732 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:21.228691 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:27:33.904728 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.904689 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29"] Jun 14 03:27:33.908556 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.908534 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:33.911140 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.911117 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 14 03:27:33.920109 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.920085 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29"] Jun 14 03:27:33.928042 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.928002 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:27:33.977785 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.977752 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:33.978001 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.977789 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:33.978001 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.977901 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsgf8\" (UniqueName: \"kubernetes.io/projected/5274b4ee-d24c-4e47-ae0c-8cd180917728-kube-api-access-qsgf8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:33.978001 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.977932 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:33.978001 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.977949 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:33.978001 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:33.977964 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5274b4ee-d24c-4e47-ae0c-8cd180917728-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.078963 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.078931 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsgf8\" (UniqueName: \"kubernetes.io/projected/5274b4ee-d24c-4e47-ae0c-8cd180917728-kube-api-access-qsgf8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.079143 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.078973 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.079143 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.078990 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.079226 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.079172 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5274b4ee-d24c-4e47-ae0c-8cd180917728-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.079266 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.079240 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.079302 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.079270 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.079402 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.079382 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.079582 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.079557 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.079702 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.079588 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.081263 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.081243 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5274b4ee-d24c-4e47-ae0c-8cd180917728-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.081552 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.081522 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5274b4ee-d24c-4e47-ae0c-8cd180917728-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.087401 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.087381 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsgf8\" (UniqueName: \"kubernetes.io/projected/5274b4ee-d24c-4e47-ae0c-8cd180917728-kube-api-access-qsgf8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29\" (UID: \"5274b4ee-d24c-4e47-ae0c-8cd180917728\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.225032 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.224941 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:34.363081 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.363055 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29"] Jun 14 03:27:34.364473 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:27:34.364447 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5274b4ee_d24c_4e47_ae0c_8cd180917728.slice/crio-3a2ac6877dd0c526ca858ba5c67d94f5099443919e8de35e2cb2ae72f83b82c2 WatchSource:0}: Error finding container 3a2ac6877dd0c526ca858ba5c67d94f5099443919e8de35e2cb2ae72f83b82c2: Status 404 returned error can't find the container with id 3a2ac6877dd0c526ca858ba5c67d94f5099443919e8de35e2cb2ae72f83b82c2 Jun 14 03:27:34.427057 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.427032 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" event={"ID":"5274b4ee-d24c-4e47-ae0c-8cd180917728","Type":"ContainerStarted","Data":"3a2ac6877dd0c526ca858ba5c67d94f5099443919e8de35e2cb2ae72f83b82c2"} Jun 14 03:27:34.823577 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:34.823540 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:27:35.434645 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:35.434609 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" event={"ID":"5274b4ee-d24c-4e47-ae0c-8cd180917728","Type":"ContainerStarted","Data":"87719945c3467774e776abcacb15a7ce7a53db14a791f77cfb960b414031eb0a"} Jun 14 03:27:36.441495 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:36.441452 2547 generic.go:356] "Generic (PLEG): container finished" podID="5274b4ee-d24c-4e47-ae0c-8cd180917728" containerID="87719945c3467774e776abcacb15a7ce7a53db14a791f77cfb960b414031eb0a" exitCode=0 Jun 14 03:27:36.441997 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:36.441541 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" event={"ID":"5274b4ee-d24c-4e47-ae0c-8cd180917728","Type":"ContainerDied","Data":"87719945c3467774e776abcacb15a7ce7a53db14a791f77cfb960b414031eb0a"} Jun 14 03:27:38.456664 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:38.456630 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" event={"ID":"5274b4ee-d24c-4e47-ae0c-8cd180917728","Type":"ContainerStarted","Data":"09ae3324dc70e080eb161147b9975c1c615997c371d271016c345c847f82a4cd"} Jun 14 03:27:38.478369 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:38.478316 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" podStartSLOduration=2.866758722 podStartE2EDuration="5.47830047s" totalImagesPullingTime="987.99608ms" totalInitContainerRuntime="1.623545668s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:27:38.475615174 +0000 UTC m=+881.591229374" watchObservedRunningTime="2026-06-14 03:27:38.47830047 +0000 UTC m=+881.593914668" Jun 14 03:27:44.225916 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:44.225879 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:44.226370 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:44.226246 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:44.238737 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:44.238707 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:44.502053 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:44.501972 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29" Jun 14 03:27:50.328689 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:50.328582 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:27:51.325027 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:51.324990 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:27:57.380508 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:57.380477 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:27:57.388748 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:27:57.388726 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:28:12.090139 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:12.090101 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:28:13.425475 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:13.425438 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:28:33.776134 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:33.776101 2547 generic.go:356] "Generic (PLEG): container finished" podID="03023aa1-a984-47aa-a18c-743404bfc5c0" containerID="c1f7e59848dbbcdeac501c85d9e0dc04eb25576375ada925dda0f1ef2270a120" exitCode=0 Jun 14 03:28:33.776665 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:33.776176 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" event={"ID":"03023aa1-a984-47aa-a18c-743404bfc5c0","Type":"ContainerDied","Data":"c1f7e59848dbbcdeac501c85d9e0dc04eb25576375ada925dda0f1ef2270a120"} Jun 14 03:28:33.776976 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:33.776957 2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 03:28:34.784387 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:34.784351 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" event={"ID":"03023aa1-a984-47aa-a18c-743404bfc5c0","Type":"ContainerStarted","Data":"272c2ccbc0222f6bc25f8b6df401ca47bac20e2b77081f16f7194222c298b319"} Jun 14 03:28:34.804135 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:34.804083 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" podStartSLOduration=2.574064285 podStartE2EDuration="1m25.804066182s" totalImagesPullingTime="3.016432475s" totalInitContainerRuntime="1m20.213569422s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:27:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:28:34.801159496 +0000 UTC m=+937.916773695" watchObservedRunningTime="2026-06-14 03:28:34.804066182 +0000 UTC m=+937.919680380" Jun 14 03:28:38.719716 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:38.719681 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:28:38.777526 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:38.777490 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:28:39.910965 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:39.910931 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:28:39.911396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:39.910992 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:28:39.923635 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:39.923608 2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:28:40.063087 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:40.063058 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:28:40.841401 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:28:40.841363 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-zp8ss" Jun 14 03:29:46.899902 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:29:46.899869 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:29:46.954895 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:29:46.954858 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:30:53.757094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:30:53.757010 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:30:53.807415 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:30:53.807376 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:31:42.815437 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:31:42.815393 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:31:42.911005 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:31:42.910967 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:31:43.927054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:31:43.927021 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:31:44.012728 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:31:44.012693 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:32:14.126111 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:32:14.126070 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:32:24.332391 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:32:24.332304 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:32:33.426064 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:32:33.426028 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:32:43.721548 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:32:43.721511 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:32:53.824045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:32:53.824007 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:32:57.426101 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:32:57.426038 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:32:57.435317 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:32:57.435291 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:33:03.529534 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:03.529489 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:33:10.546990 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:10.546928 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:33:10.651551 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:10.651516 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8494c94465-fmrwz"] Jun 14 03:33:10.651733 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:10.651710 2547 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8494c94465-fmrwz" podUID="2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e" containerName="manager" containerID="cri-o://083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc" gracePeriod=30 Jun 14 03:33:10.901447 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:10.901418 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:33:11.004393 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.004356 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-webhook-cert\") pod \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\" (UID: \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\") " Jun 14 03:33:11.004590 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.004455 2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8qc6\" (UniqueName: \"kubernetes.io/projected/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-kube-api-access-x8qc6\") pod \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\" (UID: \"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e\") " Jun 14 03:33:11.006528 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.006498 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e" (UID: "2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 03:33:11.006677 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.006655 2547 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-kube-api-access-x8qc6" (OuterVolumeSpecName: "kube-api-access-x8qc6") pod "2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e" (UID: "2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e"). InnerVolumeSpecName "kube-api-access-x8qc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 03:33:11.105617 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.105527 2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8qc6\" (UniqueName: \"kubernetes.io/projected/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-kube-api-access-x8qc6\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:33:11.105617 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.105560 2547 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e-webhook-cert\") on node \"ip-10-0-137-82.ec2.internal\" DevicePath \"\"" Jun 14 03:33:11.383422 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.383340 2547 generic.go:356] "Generic (PLEG): container finished" podID="2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e" containerID="083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc" exitCode=0 Jun 14 03:33:11.383422 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.383386 2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8494c94465-fmrwz" Jun 14 03:33:11.383623 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.383425 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8494c94465-fmrwz" event={"ID":"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e","Type":"ContainerDied","Data":"083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc"} Jun 14 03:33:11.383623 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.383477 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8494c94465-fmrwz" event={"ID":"2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e","Type":"ContainerDied","Data":"6bc49304ee46999f0cf41e36cbc6466b30ce10ef3d856505b421066c5babb722"} Jun 14 03:33:11.383623 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.383501 2547 scope.go:117] "RemoveContainer" containerID="083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc" Jun 14 03:33:11.392613 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.392594 2547 scope.go:117] "RemoveContainer" containerID="083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc" Jun 14 03:33:11.392910 ip-10-0-137-82 kubenswrapper[2547]: E0614 03:33:11.392891 2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc\": container with ID starting with 083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc not found: ID does not exist" containerID="083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc" Jun 14 03:33:11.392963 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.392934 2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc"} err="failed to get container status \"083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc\": rpc error: code = NotFound desc = could not find container \"083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc\": container with ID starting with 083e42844fe1178328d8ccc1bd6c767db985d5c9d3b24bc3071903e63fea27dc not found: ID does not exist" Jun 14 03:33:11.400785 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.400760 2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8494c94465-fmrwz"] Jun 14 03:33:11.406003 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:11.405980 2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8494c94465-fmrwz"] Jun 14 03:33:12.036318 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.036285 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:33:12.157210 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.157182 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8494c94465-fkbfs"] Jun 14 03:33:12.162626 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.157551 2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e" containerName="manager" Jun 14 03:33:12.162626 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.157562 2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e" containerName="manager" Jun 14 03:33:12.162626 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.157618 2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e" containerName="manager" Jun 14 03:33:12.162626 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.161853 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8494c94465-fkbfs" Jun 14 03:33:12.165487 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.165460 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 03:33:12.165602 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.165524 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 03:33:12.165753 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.165738 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kzmt7\"" Jun 14 03:33:12.169329 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.169306 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8494c94465-fkbfs"] Jun 14 03:33:12.214891 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.214857 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da28fda7-a56b-4081-96bf-fe9f0b5db953-webhook-cert\") pod \"maas-controller-8494c94465-fkbfs\" (UID: \"da28fda7-a56b-4081-96bf-fe9f0b5db953\") " pod="opendatahub/maas-controller-8494c94465-fkbfs" Jun 14 03:33:12.215067 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.214906 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phg6m\" (UniqueName: \"kubernetes.io/projected/da28fda7-a56b-4081-96bf-fe9f0b5db953-kube-api-access-phg6m\") pod \"maas-controller-8494c94465-fkbfs\" (UID: \"da28fda7-a56b-4081-96bf-fe9f0b5db953\") " pod="opendatahub/maas-controller-8494c94465-fkbfs" Jun 14 03:33:12.315876 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.315732 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da28fda7-a56b-4081-96bf-fe9f0b5db953-webhook-cert\") pod \"maas-controller-8494c94465-fkbfs\" (UID: \"da28fda7-a56b-4081-96bf-fe9f0b5db953\") " pod="opendatahub/maas-controller-8494c94465-fkbfs" Jun 14 03:33:12.315876 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.315826 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phg6m\" (UniqueName: \"kubernetes.io/projected/da28fda7-a56b-4081-96bf-fe9f0b5db953-kube-api-access-phg6m\") pod \"maas-controller-8494c94465-fkbfs\" (UID: \"da28fda7-a56b-4081-96bf-fe9f0b5db953\") " pod="opendatahub/maas-controller-8494c94465-fkbfs" Jun 14 03:33:12.318383 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.318357 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/da28fda7-a56b-4081-96bf-fe9f0b5db953-webhook-cert\") pod \"maas-controller-8494c94465-fkbfs\" (UID: \"da28fda7-a56b-4081-96bf-fe9f0b5db953\") " pod="opendatahub/maas-controller-8494c94465-fkbfs" Jun 14 03:33:12.323751 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.323728 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phg6m\" (UniqueName: \"kubernetes.io/projected/da28fda7-a56b-4081-96bf-fe9f0b5db953-kube-api-access-phg6m\") pod \"maas-controller-8494c94465-fkbfs\" (UID: \"da28fda7-a56b-4081-96bf-fe9f0b5db953\") " pod="opendatahub/maas-controller-8494c94465-fkbfs" Jun 14 03:33:12.474115 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.474081 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8494c94465-fkbfs" Jun 14 03:33:12.610377 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:12.610345 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8494c94465-fkbfs"] Jun 14 03:33:12.612433 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:33:12.612399 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda28fda7_a56b_4081_96bf_fe9f0b5db953.slice/crio-c3dc26b1136050fc9a55740c3cbaef66764397b65d3c88f86a048a0281a29dc8 WatchSource:0}: Error finding container c3dc26b1136050fc9a55740c3cbaef66764397b65d3c88f86a048a0281a29dc8: Status 404 returned error can't find the container with id c3dc26b1136050fc9a55740c3cbaef66764397b65d3c88f86a048a0281a29dc8 Jun 14 03:33:13.341012 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:13.340937 2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e" path="/var/lib/kubelet/pods/2ac0ddfa-4c2d-4801-a2bb-3c178f67c85e/volumes" Jun 14 03:33:13.396936 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:13.396902 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8494c94465-fkbfs" event={"ID":"da28fda7-a56b-4081-96bf-fe9f0b5db953","Type":"ContainerStarted","Data":"742bc3c2d974b68180ef8bdea992f5abeab3a191d3754a1ee0f41cc1a29cc389"} Jun 14 03:33:13.397099 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:13.396958 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8494c94465-fkbfs" event={"ID":"da28fda7-a56b-4081-96bf-fe9f0b5db953","Type":"ContainerStarted","Data":"c3dc26b1136050fc9a55740c3cbaef66764397b65d3c88f86a048a0281a29dc8"} Jun 14 03:33:13.397099 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:13.397008 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8494c94465-fkbfs" Jun 14 03:33:13.414171 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:13.414127 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8494c94465-fkbfs" podStartSLOduration=0.945318685 podStartE2EDuration="1.41411094s" totalImagesPullingTime="468.792255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 03:33:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:33:13.412184098 +0000 UTC m=+1216.527798298" watchObservedRunningTime="2026-06-14 03:33:13.41411094 +0000 UTC m=+1216.529725138" Jun 14 03:33:24.408249 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:24.408216 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8494c94465-fkbfs" Jun 14 03:33:35.833600 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:35.833560 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:33:40.615917 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:40.615882 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:33:54.109288 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:54.109208 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:33:54.206508 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:33:54.206469 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:34:02.604036 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:34:02.603994 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:34:08.202963 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:34:08.202897 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:34:08.303622 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:34:08.303584 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:34:17.719339 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:34:17.719292 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:34:33.920835 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:34:33.920786 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:34:40.422581 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:34:40.422543 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:34:40.514845 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:34:40.514791 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:04.375951 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:04.375918 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:10.132652 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:10.132612 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:10.195497 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:10.195465 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:10.272238 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:10.272208 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:10.368725 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:10.368691 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:10.498675 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:10.498642 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:10.598085 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:10.598049 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:11.933395 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:11.933358 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:35:27.124324 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:27.124238 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:27.224822 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:27.224745 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:27.324831 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:27.324784 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:28.532117 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:28.532074 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:35:33.013154 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:33.013104 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:33.115299 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:33.115265 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:41.146365 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:41.146331 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:41.246787 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:41.246755 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:41.346351 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:41.346308 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:41.446887 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:41.446853 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:43.127891 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:43.127855 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:35:57.874532 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:57.874485 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:57.985770 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:57.985735 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:58.093396 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:58.093363 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:35:59.318601 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:35:59.318565 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:36:03.617358 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:03.617310 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:03.668952 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:03.668917 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:19.918068 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:19.918031 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:20.018146 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:20.018113 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:20.122056 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:20.122010 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:25.671814 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:25.671761 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:25.728877 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:25.728841 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:25.801442 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:25.801405 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:25.900027 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:25.899990 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:26.011367 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:26.011285 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:31.807760 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:31.807724 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:31.908708 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:31.908673 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:40.658464 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:40.658426 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:40.708408 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:40.708373 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:36:58.326880 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:36:58.326786 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:37:07.123560 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:37:07.123518 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:37:23.920452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:37:23.920412 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:37:32.523841 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:37:32.523795 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:37:45.588057 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:37:45.588025 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:37:49.833779 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:37:49.833744 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:37:57.465415 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:37:57.465385 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:37:57.476649 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:37:57.476626 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:37:58.522194 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:37:58.522158 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:38:30.726861 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:38:30.726760 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:38:39.730838 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:38:39.730786 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:38:48.127568 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:38:48.127532 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:38:55.927033 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:38:55.926998 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:39:04.517156 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:39:04.517119 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:39:13.222839 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:39:13.222790 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:39:17.325034 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:39:17.324995 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:39:29.919342 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:39:29.919310 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:39:41.722560 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:39:41.722520 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:40:29.922720 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:40:29.922684 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:40:36.330089 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:40:36.330055 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:40:41.338651 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:40:41.338614 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:40:42.692910 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:40:42.692869 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:40:56.418516 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:40:56.418479 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:41:01.619730 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:41:01.619693 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:41:04.725269 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:41:04.725231 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:41:15.023993 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:41:15.023956 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:41:23.318719 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:41:23.318630 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:41:33.116734 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:41:33.116696 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:41:40.823080 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:41:40.823040 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:41:50.520847 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:41:50.520791 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:41:58.120713 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:41:58.120673 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:42:06.020357 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:42:06.020314 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:42:14.126816 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:42:14.126765 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:42:57.505187 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:42:57.505156 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:42:57.523320 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:42:57.523290 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:44:36.925919 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:44:36.925828 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:44:41.420662 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:44:41.420625 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:45:07.422721 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:45:07.422684 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:45:11.023907 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:45:11.023862 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:45:21.826857 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:45:21.826810 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:45:30.012104 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:45:30.012063 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:45:30.100650 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:45:30.100610 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:45:30.926015 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:45:30.925982 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:45:41.424975 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:45:41.424937 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:45:50.720247 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:45:50.720167 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:46:00.519911 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:46:00.519872 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:46:09.627358 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:46:09.627318 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:46:18.330351 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:46:18.330307 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:46:24.696674 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:46:24.696637 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:46:25.790862 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:46:25.790782 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:46:29.328045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:46:29.328012 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:46:38.426934 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:46:38.426895 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:46:43.622890 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:46:43.622845 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:47:13.019234 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:47:13.019195 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:47:56.024013 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:47:56.023924 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:47:57.550272 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:47:57.550240 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:47:57.563218 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:47:57.563193 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:48:04.825186 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:48:04.825144 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:48:13.128272 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:48:13.128234 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:48:21.821680 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:48:21.821644 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:48:31.722704 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:48:31.722664 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:48:43.123118 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:48:43.123080 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:48:53.322434 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:48:53.322351 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:48:57.424489 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:48:57.424451 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:49:06.523023 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:49:06.522981 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:49:14.825068 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:49:14.825030 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:49:22.825957 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:49:22.825918 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:49:33.420907 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:49:33.420867 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:49:52.721680 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:49:52.721642 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:49:59.924890 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:49:59.924859 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:50:09.925367 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:50:09.925327 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:50:17.223393 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:50:17.223308 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:50:35.424818 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:50:35.424759 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:50:42.624983 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:50:42.624947 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:50:51.321767 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:50:51.321726 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:50:59.823045 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:50:59.823004 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:51:07.137681 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:51:07.137639 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:51:07.190190 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:51:07.190149 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:51:08.722273 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:51:08.722237 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:51:17.329326 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:51:17.329291 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:51:26.225525 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:51:26.225484 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:51:37.025788 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:51:37.025751 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:51:47.524250 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:51:47.524167 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:51:59.423096 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:51:59.423065 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:52:08.625597 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:52:08.625563 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:52:14.123940 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:52:14.123896 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:52:21.116505 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:52:21.116462 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:52:26.326626 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:52:26.326591 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:52:40.921899 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:52:40.921858 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:52:49.619605 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:52:49.619564 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:52:57.590788 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:52:57.590762 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:52:57.609433 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:52:57.609402 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zbx79_9fa2fcc0-2d83-41f7-adb4-87d3a3ff51ba/ovn-acl-logging/0.log" Jun 14 03:52:57.641027 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:52:57.640994 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:52:59.016627 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:52:59.016593 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:53:00.920054 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:00.920008 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:05.522825 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:05.522778 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:53:25.191568 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:25.191481 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:26.717777 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:26.717740 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:53:38.246616 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:38.246581 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:39.425918 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:39.425885 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-v77t5"] Jun 14 03:53:39.808767 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:39.808687 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:39.900960 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:39.900921 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:40.261173 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:40.261138 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:45.829417 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:45.829374 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:45.932854 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:45.932815 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:46.023859 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:46.023821 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:46.073545 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:46.073508 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:46.202137 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:46.202093 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:46.300776 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:46.300743 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:49.460007 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:49.459959 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:52.271950 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:52.271917 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:52.462184 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:52.462147 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:52.567022 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:52.566939 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:54.486762 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:54.486708 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:58.154693 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:58.154656 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:58.255331 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:58.255295 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:58.385433 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:58.385397 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:58.443130 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:58.443044 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:58.545484 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:58.545451 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:53:58.644498 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:53:58.644456 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:54:01.636011 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:01.635964 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:54:04.639368 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:04.639331 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:54:05.810218 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:05.810184 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:54:05.911416 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:05.911386 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:54:07.299746 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:07.299683 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:54:11.718290 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:11.718252 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:54:11.777199 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:11.777162 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:54:22.502189 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:22.502159 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d54cc8554-bqkt4_c104e6e6-2111-434a-ab2a-3ce03c515f42/nginx/0.log" Jun 14 03:54:22.738459 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:22.738416 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-nbmxx_19dc042e-08b6-4d3a-b7fb-76f42b38f6bd/manager/0.log" Jun 14 03:54:22.856003 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:22.855926 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-586wr_f0dad2ce-1296-4da7-a3c0-76a3c68ba96d/manager/0.log" Jun 14 03:54:23.331940 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:23.331906 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8494c94465-fkbfs_da28fda7-a56b-4081-96bf-fe9f0b5db953/manager/0.log" Jun 14 03:54:23.448296 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:23.448267 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9kdgn_5b350850-a567-45b4-9a11-ddd5a7ecdae6/server/0.log" Jun 14 03:54:23.566853 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:23.566821 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-jlhv9_e8c45c8e-f2b6-4fb8-a582-2f29f59eb658/manager/0.log" Jun 14 03:54:23.685656 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:23.685624 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2_b8eae150-0473-4f2b-97f4-b85b65f62d69/copy-manifests/0.log" Jun 14 03:54:23.692167 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:23.692144 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2_b8eae150-0473-4f2b-97f4-b85b65f62d69/manager/0.log" Jun 14 03:54:24.806848 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:24.806796 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf_c95db13d-c905-4bb6-bf33-ef1fa705ec15/util/0.log" Jun 14 03:54:24.812867 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:24.812845 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf_c95db13d-c905-4bb6-bf33-ef1fa705ec15/pull/0.log" Jun 14 03:54:24.819286 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:24.819262 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf_c95db13d-c905-4bb6-bf33-ef1fa705ec15/extract/0.log" Jun 14 03:54:24.927258 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:24.927230 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd_abb7a6ae-14d3-40bc-aae0-3a4199ffedf9/util/0.log" Jun 14 03:54:24.933425 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:24.933398 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd_abb7a6ae-14d3-40bc-aae0-3a4199ffedf9/pull/0.log" Jun 14 03:54:24.939505 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:24.939489 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd_abb7a6ae-14d3-40bc-aae0-3a4199ffedf9/extract/0.log" Jun 14 03:54:25.051071 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:25.051040 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg_771516e9-a9bd-4836-8270-d39dc1331178/util/0.log" Jun 14 03:54:25.057736 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:25.057680 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg_771516e9-a9bd-4836-8270-d39dc1331178/pull/0.log" Jun 14 03:54:25.064613 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:25.064591 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg_771516e9-a9bd-4836-8270-d39dc1331178/extract/0.log" Jun 14 03:54:25.173030 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:25.172999 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q_0be01209-c951-4583-9529-5dfd79a9beeb/extract/0.log" Jun 14 03:54:25.179301 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:25.179278 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q_0be01209-c951-4583-9529-5dfd79a9beeb/util/0.log" Jun 14 03:54:25.185581 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:25.185564 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q_0be01209-c951-4583-9529-5dfd79a9beeb/pull/0.log" Jun 14 03:54:25.442449 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:25.442411 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m7cs5_14b3b628-845f-4f2a-bac5-5e205ad3a985/manager/0.log" Jun 14 03:54:26.027659 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:26.027628 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-v77t5_f9a8f3d9-e296-4bf2-ac99-cd65067885c7/limitador/0.log" Jun 14 03:54:26.606947 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:26.606915 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-drtzj_278d4fd5-ca26-4eab-9b5d-18fee045c4cc/discovery/0.log" Jun 14 03:54:26.826322 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:26.826293 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6fc8f5d7-4qcj2_5d358c1c-89be-4c80-ae5b-c5b230ffcd35/kube-auth-proxy/0.log" Jun 14 03:54:27.733094 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:27.733059 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-zp8ss_03023aa1-a984-47aa-a18c-743404bfc5c0/storage-initializer/0.log" Jun 14 03:54:27.739952 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:27.739924 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-zp8ss_03023aa1-a984-47aa-a18c-743404bfc5c0/main/0.log" Jun 14 03:54:27.969216 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:27.969182 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29_5274b4ee-d24c-4e47-ae0c-8cd180917728/main/0.log" Jun 14 03:54:27.975971 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:27.975948 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c68w29_5274b4ee-d24c-4e47-ae0c-8cd180917728/storage-initializer/0.log" Jun 14 03:54:31.868355 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:31.868321 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:54:31.945121 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:31.945086 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:54:34.821767 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:34.821733 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x2pv9_75593b11-91aa-4a6a-843b-cfb6d38be68d/global-pull-secret-syncer/0.log" Jun 14 03:54:34.902959 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:34.902930 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" Jun 14 03:54:34.983117 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:34.983086 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-82.ec2.internal_0ba8465d2da51165232acdafa2e3a2b9/haproxy/0.log" Jun 14 03:54:38.198227 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:38.198188 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-7rtr7_fc915248-f0d2-4cb9-8b82-fa91a1dcf03c/sail-operator/0.log" Jun 14 03:54:39.600990 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.600964 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf_c95db13d-c905-4bb6-bf33-ef1fa705ec15/extract/0.log" Jun 14 03:54:39.631358 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.631326 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf_c95db13d-c905-4bb6-bf33-ef1fa705ec15/util/0.log" Jun 14 03:54:39.656188 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.656162 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vbhmf_c95db13d-c905-4bb6-bf33-ef1fa705ec15/pull/0.log" Jun 14 03:54:39.693357 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.693334 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd_abb7a6ae-14d3-40bc-aae0-3a4199ffedf9/extract/0.log" Jun 14 03:54:39.724640 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.724614 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd_abb7a6ae-14d3-40bc-aae0-3a4199ffedf9/util/0.log" Jun 14 03:54:39.748702 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.748673 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04n9zd_abb7a6ae-14d3-40bc-aae0-3a4199ffedf9/pull/0.log" Jun 14 03:54:39.779101 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.779073 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg_771516e9-a9bd-4836-8270-d39dc1331178/extract/0.log" Jun 14 03:54:39.803495 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.803471 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg_771516e9-a9bd-4836-8270-d39dc1331178/util/0.log" Jun 14 03:54:39.823576 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.823548 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7358cmg_771516e9-a9bd-4836-8270-d39dc1331178/pull/0.log" Jun 14 03:54:39.862205 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.862139 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q_0be01209-c951-4583-9529-5dfd79a9beeb/extract/0.log" Jun 14 03:54:39.897665 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.897640 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q_0be01209-c951-4583-9529-5dfd79a9beeb/util/0.log" Jun 14 03:54:39.929223 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:39.929199 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12s79q_0be01209-c951-4583-9529-5dfd79a9beeb/pull/0.log" Jun 14 03:54:40.294240 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:40.294211 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m7cs5_14b3b628-845f-4f2a-bac5-5e205ad3a985/manager/0.log" Jun 14 03:54:40.501130 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:40.501099 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-v77t5_f9a8f3d9-e296-4bf2-ac99-cd65067885c7/limitador/0.log" Jun 14 03:54:42.351525 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:42.351499 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-v9frh_1c0ff60d-21c8-4644-9dbd-49128a980604/kube-state-metrics/0.log" Jun 14 03:54:42.374884 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:42.374860 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-v9frh_1c0ff60d-21c8-4644-9dbd-49128a980604/kube-rbac-proxy-main/0.log" Jun 14 03:54:42.395423 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:42.395405 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-v9frh_1c0ff60d-21c8-4644-9dbd-49128a980604/kube-rbac-proxy-self/0.log" Jun 14 03:54:42.425567 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:42.425548 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-86885df98-szk9w_b1234228-0c89-4eaa-8675-9128af02dae8/metrics-server/0.log" Jun 14 03:54:42.697276 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:42.697249 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z79pf_ca8e72d4-1de1-4b52-8ca7-ee946e745661/node-exporter/0.log" Jun 14 03:54:42.724353 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:42.724328 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z79pf_ca8e72d4-1de1-4b52-8ca7-ee946e745661/kube-rbac-proxy/0.log" Jun 14 03:54:42.750923 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:42.750896 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z79pf_ca8e72d4-1de1-4b52-8ca7-ee946e745661/init-textfile/0.log" Jun 14 03:54:46.007674 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.007642 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-mk9zx_4927dc0a-630a-4a1f-98e3-1c07deb6addb/download-server/0.log" Jun 14 03:54:46.636520 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.636486 2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8"] Jun 14 03:54:46.640144 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.640127 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.642494 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.642468 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm758\"/\"kube-root-ca.crt\"" Jun 14 03:54:46.642683 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.642592 2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hm758\"/\"openshift-service-ca.crt\"" Jun 14 03:54:46.643489 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.643470 2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hm758\"/\"default-dockercfg-xdkrk\"" Jun 14 03:54:46.649469 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.649445 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8"] Jun 14 03:54:46.749270 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.749188 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-proc\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.749427 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.749275 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-podres\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.749427 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.749299 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-sys\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.749427 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.749316 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-lib-modules\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.749531 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.749437 2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbwfm\" (UniqueName: \"kubernetes.io/projected/ac498da1-ee57-4735-a7e8-89938f8198c9-kube-api-access-fbwfm\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.850335 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.850301 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-proc\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.850531 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.850365 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-podres\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.850531 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.850381 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-sys\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.850531 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.850444 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-sys\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.850531 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.850453 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-proc\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.850531 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.850488 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-lib-modules\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.850531 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.850497 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-podres\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.850845 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.850557 2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbwfm\" (UniqueName: \"kubernetes.io/projected/ac498da1-ee57-4735-a7e8-89938f8198c9-kube-api-access-fbwfm\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.850845 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.850594 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac498da1-ee57-4735-a7e8-89938f8198c9-lib-modules\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.859860 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.859840 2547 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbwfm\" (UniqueName: \"kubernetes.io/projected/ac498da1-ee57-4735-a7e8-89938f8198c9-kube-api-access-fbwfm\") pod \"perf-node-gather-daemonset-ggrh8\" (UID: \"ac498da1-ee57-4735-a7e8-89938f8198c9\") " pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:46.951348 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:46.951317 2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:47.092316 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:47.092290 2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8"] Jun 14 03:54:47.093943 ip-10-0-137-82 kubenswrapper[2547]: W0614 03:54:47.093919 2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac498da1_ee57_4735_a7e8_89938f8198c9.slice/crio-29c79cab02e9e6d44d6566b90e7fcfe0903aa63b42e8cf58cd91a3cee9bfb6dd WatchSource:0}: Error finding container 29c79cab02e9e6d44d6566b90e7fcfe0903aa63b42e8cf58cd91a3cee9bfb6dd: Status 404 returned error can't find the container with id 29c79cab02e9e6d44d6566b90e7fcfe0903aa63b42e8cf58cd91a3cee9bfb6dd Jun 14 03:54:47.780459 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:47.780422 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" event={"ID":"ac498da1-ee57-4735-a7e8-89938f8198c9","Type":"ContainerStarted","Data":"bc2e4ec66d23ba665934b422b1d3fd66b21de340f53a775527cdf17d93f5a25c"} Jun 14 03:54:47.780643 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:47.780475 2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" event={"ID":"ac498da1-ee57-4735-a7e8-89938f8198c9","Type":"ContainerStarted","Data":"29c79cab02e9e6d44d6566b90e7fcfe0903aa63b42e8cf58cd91a3cee9bfb6dd"} Jun 14 03:54:47.780643 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:47.780500 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:47.796731 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:47.796686 2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" podStartSLOduration=1.796672478 podStartE2EDuration="1.796672478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 03:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 03:54:47.793889049 +0000 UTC m=+2510.909503249" watchObservedRunningTime="2026-06-14 03:54:47.796672478 +0000 UTC m=+2510.912286677" Jun 14 03:54:47.898390 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:47.898345 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pcxsf_34053198-82d1-4bd6-ac10-c8ba3216c9bb/dns/0.log" Jun 14 03:54:47.922466 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:47.922423 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pcxsf_34053198-82d1-4bd6-ac10-c8ba3216c9bb/kube-rbac-proxy/0.log" Jun 14 03:54:48.033863 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:48.033769 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-slkjx_2f4685d5-520b-4fad-bb63-a3020ec632a1/dns-node-resolver/0.log" Jun 14 03:54:48.555748 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:48.555715 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-565c584dd-lg8s7_de8d6d0b-3347-47b6-8bf1-ffe970a48072/registry/0.log" Jun 14 03:54:48.598412 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:48.598382 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qrlfx_d746952d-090b-4847-b215-57c2cc49a738/node-ca/0.log" Jun 14 03:54:49.611179 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:49.611139 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-drtzj_278d4fd5-ca26-4eab-9b5d-18fee045c4cc/discovery/0.log" Jun 14 03:54:49.656773 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:49.656739 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6fc8f5d7-4qcj2_5d358c1c-89be-4c80-ae5b-c5b230ffcd35/kube-auth-proxy/0.log" Jun 14 03:54:50.518935 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:50.518887 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qt8pz_c0f6c0a1-34ad-4271-853b-fb196399dd18/serve-healthcheck-canary/0.log" Jun 14 03:54:51.020325 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:51.020293 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-f8ptq_988f4a36-8720-400e-b3f8-d0d879d82c85/insights-operator/0.log" Jun 14 03:54:51.020325 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:51.020316 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-f8ptq_988f4a36-8720-400e-b3f8-d0d879d82c85/insights-operator/1.log" Jun 14 03:54:51.113152 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:51.113123 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vnb6w_59f5a884-8035-4b95-82dd-43d852324113/kube-rbac-proxy/0.log" Jun 14 03:54:51.133893 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:51.133864 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vnb6w_59f5a884-8035-4b95-82dd-43d852324113/exporter/0.log" Jun 14 03:54:51.153969 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:51.153934 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vnb6w_59f5a884-8035-4b95-82dd-43d852324113/extractor/0.log" Jun 14 03:54:53.499987 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:53.499948 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d54cc8554-bqkt4_c104e6e6-2111-434a-ab2a-3ce03c515f42/nginx/0.log" Jun 14 03:54:53.549380 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:53.549349 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-nbmxx_19dc042e-08b6-4d3a-b7fb-76f42b38f6bd/manager/0.log" Jun 14 03:54:53.623247 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:53.623195 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-586wr_f0dad2ce-1296-4da7-a3c0-76a3c68ba96d/manager/0.log" Jun 14 03:54:53.772185 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:53.772093 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8494c94465-fkbfs_da28fda7-a56b-4081-96bf-fe9f0b5db953/manager/0.log" Jun 14 03:54:53.793309 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:53.793284 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-9kdgn_5b350850-a567-45b4-9a11-ddd5a7ecdae6/server/0.log" Jun 14 03:54:53.796407 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:53.796382 2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hm758/perf-node-gather-daemonset-ggrh8" Jun 14 03:54:53.843018 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:53.842986 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-jlhv9_e8c45c8e-f2b6-4fb8-a582-2f29f59eb658/manager/0.log" Jun 14 03:54:53.866323 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:53.866293 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2_b8eae150-0473-4f2b-97f4-b85b65f62d69/manager/0.log" Jun 14 03:54:53.885849 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:53.885824 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bb65bb8c8-4sbr2_b8eae150-0473-4f2b-97f4-b85b65f62d69/copy-manifests/0.log" Jun 14 03:54:58.912893 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:54:58.912858 2547 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x29m_27d18006-e419-4f76-8273-9c5959153118/konnectivity-agent/0.log" limit=1024 Jun 14 03:55:00.153884 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:00.153854 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-drtzj_278d4fd5-ca26-4eab-9b5d-18fee045c4cc/discovery/0.log" Jun 14 03:55:00.183083 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:00.183057 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6fc8f5d7-4qcj2_5d358c1c-89be-4c80-ae5b-c5b230ffcd35/kube-auth-proxy/0.log" Jun 14 03:55:01.487338 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:01.487305 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-5zppm_4dd7804f-6835-4629-b817-f441cb2ac2ae/kube-storage-version-migrator-operator/1.log" Jun 14 03:55:01.488154 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:01.488134 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-5zppm_4dd7804f-6835-4629-b817-f441cb2ac2ae/kube-storage-version-migrator-operator/0.log" Jun 14 03:55:01.642490 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:01.642460 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-drtzj_278d4fd5-ca26-4eab-9b5d-18fee045c4cc/discovery/0.log" Jun 14 03:55:01.669355 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:01.669329 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6fc8f5d7-4qcj2_5d358c1c-89be-4c80-ae5b-c5b230ffcd35/kube-auth-proxy/0.log" Jun 14 03:55:02.675685 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:02.675656 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2mtgt_1a93097b-1f10-45a1-a343-61bfb0f2a0f6/kube-multus/0.log" Jun 14 03:55:03.005104 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.005020 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skzpc_afa64b2b-aefd-45ef-83c2-d6b12442466f/kube-multus-additional-cni-plugins/0.log" Jun 14 03:55:03.025654 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.025629 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skzpc_afa64b2b-aefd-45ef-83c2-d6b12442466f/egress-router-binary-copy/0.log" Jun 14 03:55:03.048652 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.048620 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skzpc_afa64b2b-aefd-45ef-83c2-d6b12442466f/cni-plugins/0.log" Jun 14 03:55:03.078949 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.078923 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skzpc_afa64b2b-aefd-45ef-83c2-d6b12442466f/bond-cni-plugin/0.log" Jun 14 03:55:03.098769 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.098742 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skzpc_afa64b2b-aefd-45ef-83c2-d6b12442466f/routeoverride-cni/0.log" Jun 14 03:55:03.118452 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.118423 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skzpc_afa64b2b-aefd-45ef-83c2-d6b12442466f/whereabouts-cni-bincopy/0.log" Jun 14 03:55:03.141165 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.141144 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skzpc_afa64b2b-aefd-45ef-83c2-d6b12442466f/whereabouts-cni/0.log" Jun 14 03:55:03.271147 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.271072 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d6lrk_ece5ab3c-1b05-4071-a849-e437253af84f/network-metrics-daemon/0.log" Jun 14 03:55:03.291266 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.291240 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d6lrk_ece5ab3c-1b05-4071-a849-e437253af84f/kube-rbac-proxy/0.log" Jun 14 03:55:03.652435 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.652409 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-drtzj_278d4fd5-ca26-4eab-9b5d-18fee045c4cc/discovery/0.log" Jun 14 03:55:03.677379 ip-10-0-137-82 kubenswrapper[2547]: I0614 03:55:03.677351 2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b6fc8f5d7-4qcj2_5d358c1c-89be-4c80-ae5b-c5b230ffcd35/kube-auth-proxy/0.log"