Jun 02 16:58:45.750924 ip-10-0-143-118 systemd[1]: Starting Kubernetes Kubelet... Jun 02 16:58:46.180827 ip-10-0-143-118 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:58:46.180827 ip-10-0-143-118 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 16:58:46.180827 ip-10-0-143-118 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:58:46.180827 ip-10-0-143-118 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 16:58:46.180827 ip-10-0-143-118 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 16:58:46.181632 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.181530 2561 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 16:58:46.184338 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184323 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:58:46.184338 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184338 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184344 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184347 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184350 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184353 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184356 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184359 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184362 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184365 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184372 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184375 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184377 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184380 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184382 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184385 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184388 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184391 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184394 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184396 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184399 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:58:46.184404 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184401 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184404 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184407 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184410 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184413 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184416 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184418 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184421 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184424 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184427 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184430 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184433 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184437 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184441 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184444 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184447 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184449 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184452 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184454 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:58:46.184900 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184457 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184459 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184462 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184464 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184467 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184469 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184472 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184474 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184476 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184479 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184482 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184486 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184489 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184491 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184494 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184497 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184500 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184502 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184505 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184507 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:58:46.185352 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184510 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184513 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184515 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184518 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184521 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184523 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184526 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184528 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184531 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184534 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184536 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184540 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184543 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184559 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184563 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184565 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184568 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184571 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184574 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184577 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:58:46.185852 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184579 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184582 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184584 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184587 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184589 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184592 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184962 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184967 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184970 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184973 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184976 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184979 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184981 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184984 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184986 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184989 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184992 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184995 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.184998 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185002 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:58:46.186333 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185006 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185009 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185012 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185014 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185017 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185019 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185022 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185024 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185027 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185029 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185031 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185034 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185037 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185040 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185042 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185044 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185047 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185050 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185053 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185056 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185059 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:58:46.186838 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185062 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185064 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185067 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185069 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185072 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185075 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185077 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185080 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185083 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185085 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185088 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185091 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185093 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185096 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185098 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185101 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185103 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185106 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185108 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:58:46.187396 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185110 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185113 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185115 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185118 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185120 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185123 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185125 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185127 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185130 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185133 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185135 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185139 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185141 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185144 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185147 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185151 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185154 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185157 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:58:46.187879 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185160 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185163 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185166 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185168 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185171 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185174 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185178 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185180 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185183 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185185 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185188 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185190 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185193 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185195 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185267 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185275 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185283 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185290 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185296 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185301 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185307 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 16:58:46.188321 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185311 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185314 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185318 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185321 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185325 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185328 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185331 2561 flags.go:64] FLAG: --cgroup-root="" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185334 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185337 2561 flags.go:64] FLAG: --client-ca-file="" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185341 2561 flags.go:64] FLAG: --cloud-config="" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185344 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185347 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185351 2561 flags.go:64] FLAG: --cluster-domain="" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185354 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185358 2561 flags.go:64] FLAG: --config-dir="" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185361 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185365 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185369 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185372 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185375 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185379 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185382 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185385 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185388 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185391 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 16:58:46.188915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185394 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185399 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185402 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185404 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185407 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185410 2561 flags.go:64] FLAG: --enable-server="true" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185413 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185417 2561 flags.go:64] FLAG: --event-burst="100" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185428 2561 flags.go:64] FLAG: --event-qps="50" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185432 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185436 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185439 2561 flags.go:64] FLAG: --eviction-hard="" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185443 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185446 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185449 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185452 2561 flags.go:64] FLAG: --eviction-soft="" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185455 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185458 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185461 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185464 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185467 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185469 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185472 2561 flags.go:64] FLAG: --feature-gates="" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185476 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185480 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 16:58:46.189540 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185483 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185486 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185490 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185493 2561 flags.go:64] FLAG: --help="false" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185496 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185499 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185502 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185505 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185508 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185512 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185515 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185517 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185520 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185523 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185527 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185530 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185533 2561 flags.go:64] FLAG: --kube-reserved="" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185536 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185539 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185542 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185545 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185561 2561 flags.go:64] FLAG: --lock-file="" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185565 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185570 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 16:58:46.190168 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185575 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185580 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185584 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185587 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185590 2561 flags.go:64] FLAG: --logging-format="text" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185593 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185596 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185599 2561 flags.go:64] FLAG: --manifest-url="" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185602 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185606 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185610 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185614 2561 flags.go:64] FLAG: --max-pods="110" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185617 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185620 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185623 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185626 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185629 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185632 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185635 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185643 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185646 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185649 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185652 2561 flags.go:64] FLAG: --pod-cidr="" Jun 02 16:58:46.190766 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185655 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185661 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185664 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185667 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185670 2561 flags.go:64] FLAG: --port="10250" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185673 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185675 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d29fef0ce3d8dda5" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185679 2561 flags.go:64] FLAG: --qos-reserved="" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185682 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185686 2561 flags.go:64] FLAG: --register-node="true" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185688 2561 flags.go:64] FLAG: --register-schedulable="true" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185691 2561 flags.go:64] FLAG: --register-with-taints="" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185695 2561 flags.go:64] FLAG: --registry-burst="10" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185698 2561 flags.go:64] FLAG: --registry-qps="5" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185701 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185703 2561 flags.go:64] FLAG: --reserved-memory="" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185707 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185710 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185714 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185720 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185723 2561 flags.go:64] FLAG: --runonce="false" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185726 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185729 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185732 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185735 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185739 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 16:58:46.191310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185742 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185745 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185748 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185750 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185753 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185756 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185762 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185765 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185768 2561 flags.go:64] FLAG: --system-cgroups="" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185771 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185777 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185779 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185782 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185788 2561 flags.go:64] FLAG: --tls-min-version="" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185790 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185793 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185796 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185799 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185802 2561 flags.go:64] FLAG: --v="2" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185806 2561 flags.go:64] FLAG: --version="false" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185810 2561 flags.go:64] FLAG: --vmodule="" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185814 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.185817 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185901 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185906 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:58:46.192071 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185911 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185913 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185916 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185919 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185922 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185925 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185928 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185930 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185933 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185935 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185938 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185941 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185943 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185947 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185950 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185953 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185956 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185959 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185961 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185964 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:58:46.193134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185967 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185969 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185972 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185974 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185977 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185979 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185982 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185984 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185987 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185989 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185992 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.185995 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186001 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186004 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186007 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186009 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186012 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186014 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186018 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186020 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:58:46.193917 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186023 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186026 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186028 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186031 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186033 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186038 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186041 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186043 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186046 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186048 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186051 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186054 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186056 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186059 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186061 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186064 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186067 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186070 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186072 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:58:46.194423 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186075 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186077 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186097 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186101 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186104 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186110 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186113 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186117 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186121 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186124 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186127 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186130 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186133 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186135 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186138 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186141 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186144 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186146 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186150 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:58:46.194904 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186153 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186155 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186158 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186160 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186163 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.186166 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.186755 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.194627 2561 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.194643 2561 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194691 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194696 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194700 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194703 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194706 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194709 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194712 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:58:46.195374 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194715 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194718 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194721 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194724 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194727 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194730 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194732 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194735 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194738 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194740 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194743 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194746 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194748 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194751 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194754 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194756 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194760 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194763 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194765 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194768 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:58:46.195807 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194770 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194773 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194776 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194778 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194781 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194784 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194786 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194789 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194791 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194794 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194797 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194799 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194802 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194805 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194807 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194810 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194813 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194815 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194818 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194820 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:58:46.196305 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194823 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194825 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194828 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194831 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194833 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194836 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194838 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194841 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194844 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194847 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194849 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194852 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194854 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194857 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194859 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194861 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194864 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194867 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194869 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194872 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:58:46.196829 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194875 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194877 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194880 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194882 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194885 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194889 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194893 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194897 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194900 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194905 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194908 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194911 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194914 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194917 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194920 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194923 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194925 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194928 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:58:46.197301 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.194930 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.194935 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195026 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195031 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195035 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195037 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195040 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195043 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195047 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195050 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195053 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195055 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195058 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195060 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195063 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 16:58:46.197784 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195066 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195068 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195071 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195074 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195076 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195079 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195081 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195084 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195087 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195091 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195094 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195097 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195099 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195102 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195105 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195107 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195110 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195112 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195115 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195117 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 16:58:46.198152 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195120 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195122 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195125 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195127 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195130 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195132 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195135 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195137 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195140 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195142 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195145 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195148 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195150 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195153 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195155 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195158 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195161 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195163 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195166 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195168 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 16:58:46.198655 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195171 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195173 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195177 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195179 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195182 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195184 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195187 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195189 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195193 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195196 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195199 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195202 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195205 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195208 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195211 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195214 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195216 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195219 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195222 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 16:58:46.199134 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195224 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195227 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195229 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195232 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195235 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195237 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195240 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195242 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195245 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195248 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195250 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195253 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195255 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:46.195258 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.195262 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 16:58:46.199717 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.195962 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 16:58:46.200114 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.199358 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 16:58:46.200200 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.200189 2561 server.go:1019] "Starting client certificate rotation" Jun 02 16:58:46.200308 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.200291 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 16:58:46.200341 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.200326 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 16:58:46.222195 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.222180 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 16:58:46.225628 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.225608 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 16:58:46.240289 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.240271 2561 log.go:25] "Validated CRI v1 runtime API" Jun 02 16:58:46.247313 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.247295 2561 log.go:25] "Validated CRI v1 image API" Jun 02 16:58:46.251488 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.251472 2561 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 16:58:46.252539 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.252525 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 16:58:46.254233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.254217 2561 fs.go:135] Filesystem UUIDs: map[13b5ac55-28ae-4d85-95aa-9e816e6ff73d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 921fed07-c601-440c-94a5-89c6139d7b5f:/dev/nvme0n1p3] Jun 02 16:58:46.254281 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.254233 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 16:58:46.258386 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.258285 2561 manager.go:217] Machine: {Timestamp:2026-06-02 16:58:46.257804138 +0000 UTC m=+0.376766744 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099277 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec285a76b8e90bf88f0d3e315c7c0166 SystemUUID:ec285a76-b8e9-0bf8-8f0d-3e315c7c0166 BootID:c3210783-bf5a-4d7f-a3a1-2988016813bc Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4e:d9:44:b9:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4e:d9:44:b9:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:58:64:63:75:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 16:58:46.258973 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.258963 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 16:58:46.259049 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.259037 2561 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 16:58:46.262255 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.262230 2561 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 16:58:46.262411 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.262257 2561 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-118.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 16:58:46.262492 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.262426 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 16:58:46.262492 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.262438 2561 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 16:58:46.262492 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.262448 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 16:58:46.263506 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.263494 2561 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 16:58:46.264983 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.264971 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 02 16:58:46.265109 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.265098 2561 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 16:58:46.267167 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.267155 2561 kubelet.go:491] "Attempting to sync node with API server" Jun 02 16:58:46.267224 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.267178 2561 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 16:58:46.267224 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.267194 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 16:58:46.267224 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.267207 2561 kubelet.go:397] "Adding apiserver pod source" Jun 02 16:58:46.267224 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.267220 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 16:58:46.268373 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.268359 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 16:58:46.268446 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.268382 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 16:58:46.270845 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.270830 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9vgcd" Jun 02 16:58:46.271265 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.271248 2561 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 16:58:46.273202 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.273190 2561 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 16:58:46.275577 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275563 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 16:58:46.275632 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275584 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 16:58:46.275632 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275595 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 16:58:46.275632 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275602 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 16:58:46.275632 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275611 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 16:58:46.275632 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275616 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 16:58:46.275632 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275622 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 16:58:46.275632 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275628 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 16:58:46.275632 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275634 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 16:58:46.275844 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275640 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 16:58:46.275844 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275649 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 16:58:46.275844 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.275655 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 16:58:46.276405 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.276395 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 16:58:46.276438 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.276414 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 16:58:46.279177 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.279159 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9vgcd" Jun 02 16:58:46.280093 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.280080 2561 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 16:58:46.280129 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.280120 2561 server.go:1295] "Started kubelet" Jun 02 16:58:46.280284 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.280172 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 16:58:46.280284 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.280219 2561 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 16:58:46.280284 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.280286 2561 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 16:58:46.280836 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.280813 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 16:58:46.281067 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.281047 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-118.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 16:58:46.281160 ip-10-0-143-118 systemd[1]: Started Kubernetes Kubelet. Jun 02 16:58:46.281637 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.281161 2561 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-118.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 16:58:46.281637 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.281392 2561 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 16:58:46.282801 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.282787 2561 server.go:317] "Adding debug handlers to kubelet server" Jun 02 16:58:46.291313 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.291263 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 16:58:46.291952 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.291935 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 16:58:46.292115 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292102 2561 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 16:58:46.292115 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292117 2561 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 16:58:46.292232 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.292175 2561 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 16:58:46.292232 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292213 2561 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 16:58:46.292310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292243 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 02 16:58:46.292310 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292252 2561 reconciler.go:26] "Reconciler: start to sync state" Jun 02 16:58:46.292802 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.292777 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:46.292883 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292854 2561 factory.go:153] Registering CRI-O factory Jun 02 16:58:46.292883 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292871 2561 factory.go:223] Registration of the crio container factory successfully Jun 02 16:58:46.292978 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292927 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 16:58:46.292978 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292936 2561 factory.go:55] Registering systemd factory Jun 02 16:58:46.292978 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292945 2561 factory.go:223] Registration of the systemd container factory successfully Jun 02 16:58:46.292978 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292961 2561 factory.go:103] Registering Raw factory Jun 02 16:58:46.292978 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.292977 2561 manager.go:1196] Started watching for new ooms in manager Jun 02 16:58:46.293356 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.293343 2561 manager.go:319] Starting recovery of all containers Jun 02 16:58:46.295449 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.295428 2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:58:46.297030 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.297006 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-118.ec2.internal\" not found" node="ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.303114 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.302978 2561 manager.go:324] Recovery completed Jun 02 16:58:46.304507 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.304485 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 02 16:58:46.307661 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.307649 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:58:46.311185 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.311173 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:58:46.311253 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.311198 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:58:46.311253 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.311208 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:58:46.311647 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.311632 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 16:58:46.311647 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.311644 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 16:58:46.311756 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.311659 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 02 16:58:46.314066 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.314054 2561 policy_none.go:49] "None policy: Start" Jun 02 16:58:46.314102 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.314071 2561 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 16:58:46.314102 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.314081 2561 state_mem.go:35] "Initializing new in-memory state store" Jun 02 16:58:46.361100 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.361086 2561 manager.go:341] "Starting Device Plugin manager" Jun 02 16:58:46.364800 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.361111 2561 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 16:58:46.364800 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.361121 2561 server.go:85] "Starting device plugin registration server" Jun 02 16:58:46.364800 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.361327 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 16:58:46.364800 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.361340 2561 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 16:58:46.364800 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.361589 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 16:58:46.364800 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.361704 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 16:58:46.364800 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.361714 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 16:58:46.364800 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.361993 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 16:58:46.364800 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.362028 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:46.398157 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.398126 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 16:58:46.399198 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.399184 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 16:58:46.399287 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.399207 2561 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 16:58:46.399287 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.399226 2561 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 16:58:46.399287 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.399235 2561 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 16:58:46.399287 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.399277 2561 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 16:58:46.401467 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.401447 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:58:46.462355 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.462337 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:58:46.463149 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.463135 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:58:46.463222 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.463161 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:58:46.463222 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.463170 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:58:46.463222 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.463191 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.475524 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.475502 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.475604 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.475527 2561 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-118.ec2.internal\": node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:46.486397 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.486375 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:46.500243 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.500212 2561 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal"] Jun 02 16:58:46.500302 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.500277 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:58:46.501011 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.500994 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:58:46.501069 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.501022 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:58:46.501069 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.501032 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:58:46.502203 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.502191 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:58:46.502349 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.502335 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.502402 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.502363 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:58:46.502866 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.502851 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:58:46.502938 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.502857 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:58:46.502938 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.502898 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:58:46.502938 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.502908 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:58:46.502938 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.502882 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:58:46.503120 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.502959 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:58:46.504044 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.504029 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.504120 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.504056 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 16:58:46.504634 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.504620 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientMemory" Jun 02 16:58:46.504724 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.504646 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 16:58:46.504724 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.504660 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeHasSufficientPID" Jun 02 16:58:46.530169 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.530155 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-118.ec2.internal\" not found" node="ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.533579 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.533563 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-118.ec2.internal\" not found" node="ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.586856 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.586829 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:46.593774 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.593752 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8183951f5a54887164008dea6f76276-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal\" (UID: \"c8183951f5a54887164008dea6f76276\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.593855 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.593782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8183951f5a54887164008dea6f76276-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal\" (UID: \"c8183951f5a54887164008dea6f76276\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.593855 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.593807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44685aa4636debb2744cfaa33e22af42-config\") pod \"kube-apiserver-proxy-ip-10-0-143-118.ec2.internal\" (UID: \"44685aa4636debb2744cfaa33e22af42\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.687062 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.687031 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:46.694344 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.694326 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8183951f5a54887164008dea6f76276-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal\" (UID: \"c8183951f5a54887164008dea6f76276\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.694407 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.694351 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8183951f5a54887164008dea6f76276-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal\" (UID: \"c8183951f5a54887164008dea6f76276\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.694407 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.694374 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44685aa4636debb2744cfaa33e22af42-config\") pod \"kube-apiserver-proxy-ip-10-0-143-118.ec2.internal\" (UID: \"44685aa4636debb2744cfaa33e22af42\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.694471 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.694428 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8183951f5a54887164008dea6f76276-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal\" (UID: \"c8183951f5a54887164008dea6f76276\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.694502 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.694491 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/44685aa4636debb2744cfaa33e22af42-config\") pod \"kube-apiserver-proxy-ip-10-0-143-118.ec2.internal\" (UID: \"44685aa4636debb2744cfaa33e22af42\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.694539 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.694530 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8183951f5a54887164008dea6f76276-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal\" (UID: \"c8183951f5a54887164008dea6f76276\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.787813 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.787732 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:46.833222 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.833182 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.836937 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:46.836914 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal" Jun 02 16:58:46.888753 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.888725 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:46.989209 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:46.989188 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:47.089710 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:47.089655 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:47.190261 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:47.190227 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:47.200669 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.200644 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 16:58:47.200795 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.200778 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:58:47.200835 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.200816 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 16:58:47.281218 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.281175 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 16:53:46 +0000 UTC" deadline="2028-01-23 08:27:25.266341809 +0000 UTC" Jun 02 16:58:47.281218 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.281211 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14391h28m37.985133033s" Jun 02 16:58:47.290692 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:47.290667 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:47.291333 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.291318 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 16:58:47.303478 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.303455 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 16:58:47.322691 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.322669 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rhv9w" Jun 02 16:58:47.330692 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.330676 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rhv9w" Jun 02 16:58:47.378746 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:47.378712 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44685aa4636debb2744cfaa33e22af42.slice/crio-d410d51dce76697040080acc2e2090a5c647840e7437128b5085baf8ae6b4041 WatchSource:0}: Error finding container d410d51dce76697040080acc2e2090a5c647840e7437128b5085baf8ae6b4041: Status 404 returned error can't find the container with id d410d51dce76697040080acc2e2090a5c647840e7437128b5085baf8ae6b4041 Jun 02 16:58:47.379053 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:47.379034 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8183951f5a54887164008dea6f76276.slice/crio-e2642e5c9b074aa4948bbe7f738311390e91f4e99609bc15caf72d9b099081f5 WatchSource:0}: Error finding container e2642e5c9b074aa4948bbe7f738311390e91f4e99609bc15caf72d9b099081f5: Status 404 returned error can't find the container with id e2642e5c9b074aa4948bbe7f738311390e91f4e99609bc15caf72d9b099081f5 Jun 02 16:58:47.382063 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.382045 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 16:58:47.391221 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:47.391202 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:47.403202 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.403155 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal" event={"ID":"44685aa4636debb2744cfaa33e22af42","Type":"ContainerStarted","Data":"d410d51dce76697040080acc2e2090a5c647840e7437128b5085baf8ae6b4041"} Jun 02 16:58:47.404155 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.404136 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" event={"ID":"c8183951f5a54887164008dea6f76276","Type":"ContainerStarted","Data":"e2642e5c9b074aa4948bbe7f738311390e91f4e99609bc15caf72d9b099081f5"} Jun 02 16:58:47.491324 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:47.491299 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:47.575170 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.575148 2561 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:58:47.592312 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:47.592289 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:47.692691 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:47.692621 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-118.ec2.internal\" not found" Jun 02 16:58:47.742915 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.742897 2561 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:58:47.793338 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.793300 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" Jun 02 16:58:47.805272 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.805241 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 16:58:47.806506 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.806484 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal" Jun 02 16:58:47.817014 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:47.816995 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 16:58:48.268433 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.268403 2561 apiserver.go:52] "Watching apiserver" Jun 02 16:58:48.277271 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.277240 2561 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 16:58:48.279858 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.279831 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-gxp86","openshift-ovn-kubernetes/ovnkube-node-zx4vg","kube-system/konnectivity-agent-zm6n5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz","openshift-multus/network-metrics-daemon-dfg6z","openshift-network-operator/iptables-alerter-cv4wj","kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal","openshift-cluster-node-tuning-operator/tuned-r4xx2","openshift-image-registry/node-ca-zhzh4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal","openshift-multus/multus-additional-cni-plugins-7kghr","openshift-multus/multus-b5z9j"] Jun 02 16:58:48.282642 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.282624 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:48.282752 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:48.282705 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:58:48.284818 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.284798 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.287313 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.287290 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 16:58:48.287432 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.287414 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 16:58:48.287583 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.287565 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 16:58:48.288715 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.288695 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 16:58:48.288809 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.288703 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d4z4j\"" Jun 02 16:58:48.288867 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.288775 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 16:58:48.289231 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.289210 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:58:48.289489 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.288852 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 16:58:48.291786 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.290271 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.292564 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.292410 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8fpmf\"" Jun 02 16:58:48.292564 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.292457 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 16:58:48.292564 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.292469 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 16:58:48.292917 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.292899 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 16:58:48.293643 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.293522 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:48.293643 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:48.293598 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:58:48.293643 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.293636 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 16:58:48.293839 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.293651 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 16:58:48.293839 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.293726 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t57qr\"" Jun 02 16:58:48.295772 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.295752 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.298044 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.298026 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:58:48.298367 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.298344 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 16:58:48.298940 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.298921 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c7ddb\"" Jun 02 16:58:48.299282 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.299119 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 16:58:48.301659 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.301641 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.301977 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.301960 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.303389 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-etc-openvswitch\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.303497 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-run-ovn\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.303497 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303453 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-cni-bin\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.303497 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-sys-fs\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.303751 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-log-socket\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.303751 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303541 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-cni-netd\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.303751 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-registration-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.303751 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-device-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.303751 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-kubelet\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.303751 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-run-openvswitch\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.303751 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:48.304082 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl742\" (UniqueName: \"kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742\") pod \"network-check-target-gxp86\" (UID: \"022aefb6-b970-4da3-b9f8-0f93b1f3847e\") " pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:48.304082 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e536da72-ace0-487b-879d-126733038520-env-overrides\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304082 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt2qx\" (UniqueName: \"kubernetes.io/projected/e7d51764-e935-4acf-a016-44f761ffb245-kube-api-access-gt2qx\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:48.304082 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303860 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 16:58:48.304082 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303874 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-run-netns\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304082 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e536da72-ace0-487b-879d-126733038520-ovnkube-config\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304082 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e536da72-ace0-487b-879d-126733038520-ovn-node-metrics-cert\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304082 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52f1d8f1-e0fd-49a9-9949-2fcbdde90afd-agent-certs\") pod \"konnectivity-agent-zm6n5\" (UID: \"52f1d8f1-e0fd-49a9-9949-2fcbdde90afd\") " pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:58:48.304082 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.303818 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 16:58:48.304082 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4rg5\" (UniqueName: \"kubernetes.io/projected/759ed6f5-84a7-4c03-b71e-b354ba063cda-kube-api-access-m4rg5\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304178 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304233 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e536da72-ace0-487b-879d-126733038520-ovnkube-script-lib\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304261 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bqb2\" (UniqueName: \"kubernetes.io/projected/e536da72-ace0-487b-879d-126733038520-kube-api-access-2bqb2\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304265 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304279 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mhqpv\"" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304285 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-run-systemd\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304381 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-var-lib-openvswitch\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304390 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-run-ovn-kubernetes\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-socket-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-systemd-units\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304534 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-slash\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304586 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-node-log\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304622 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52f1d8f1-e0fd-49a9-9949-2fcbdde90afd-konnectivity-ca\") pod \"konnectivity-agent-zm6n5\" (UID: \"52f1d8f1-e0fd-49a9-9949-2fcbdde90afd\") " pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:58:48.304656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.304640 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gjsmj\"" Jun 02 16:58:48.305567 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.305537 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.307797 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.307728 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.308398 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.308380 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5ngw4\"" Jun 02 16:58:48.308483 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.308411 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 16:58:48.308483 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.308424 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 16:58:48.309229 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.309207 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 16:58:48.309365 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.309210 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 16:58:48.309365 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.309219 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 16:58:48.310022 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.310003 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 16:58:48.310116 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.310082 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kj8h9\"" Jun 02 16:58:48.331431 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.331395 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:53:47 +0000 UTC" deadline="2027-12-13 20:28:21.806630769 +0000 UTC" Jun 02 16:58:48.331431 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.331424 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13419h29m33.47521028s" Jun 02 16:58:48.393452 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.393428 2561 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 16:58:48.404832 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.404805 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-systemd\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.404941 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.404843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-run-netns\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.404941 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.404870 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-hostroot\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.404941 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.404896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdnsb\" (UniqueName: \"kubernetes.io/projected/4cc1b71b-baa0-4914-8eac-a161b9d9e532-kube-api-access-fdnsb\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.404941 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.404926 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-etc-openvswitch\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405085 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.404954 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-cni-bin\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405085 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.404977 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-run\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.405085 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.404996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-sys\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.405085 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cc1b71b-baa0-4914-8eac-a161b9d9e532-cni-binary-copy\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.405085 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405020 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-cni-bin\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405085 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-etc-openvswitch\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405085 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405026 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-var-lib-cni-bin\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.405085 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405076 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-cni-netd\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405094 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-registration-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-sysctl-d\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405126 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-system-cni-dir\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405134 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-cni-netd\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f44864d-0d36-470a-92f5-3b78deac4de3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-registration-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405164 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-sysctl-conf\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405211 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkf9f\" (UniqueName: \"kubernetes.io/projected/c0694ace-bb5f-4681-baef-9117404aa775-kube-api-access-dkf9f\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405227 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:48.405235 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsbd4\" (UniqueName: \"kubernetes.io/projected/4f44864d-0d36-470a-92f5-3b78deac4de3-kube-api-access-jsbd4\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-daemon-config\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405278 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl742\" (UniqueName: \"kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742\") pod \"network-check-target-gxp86\" (UID: \"022aefb6-b970-4da3-b9f8-0f93b1f3847e\") " pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:48.405337 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:48.405322 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs podName:e7d51764-e935-4acf-a016-44f761ffb245 nodeName:}" failed. No retries permitted until 2026-06-02 16:58:48.905274474 +0000 UTC m=+3.024237073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs") pod "network-metrics-daemon-dfg6z" (UID: "e7d51764-e935-4acf-a016-44f761ffb245") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-host\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405367 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0694ace-bb5f-4681-baef-9117404aa775-tmp\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405382 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8frp\" (UniqueName: \"kubernetes.io/projected/38f08b8e-95da-4482-9d66-4ab9df185c0a-kube-api-access-h8frp\") pod \"iptables-alerter-cv4wj\" (UID: \"38f08b8e-95da-4482-9d66-4ab9df185c0a\") " pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405406 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-run-netns\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405424 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e536da72-ace0-487b-879d-126733038520-ovn-node-metrics-cert\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405439 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52f1d8f1-e0fd-49a9-9949-2fcbdde90afd-agent-certs\") pod \"konnectivity-agent-zm6n5\" (UID: \"52f1d8f1-e0fd-49a9-9949-2fcbdde90afd\") " pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405459 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4rg5\" (UniqueName: \"kubernetes.io/projected/759ed6f5-84a7-4c03-b71e-b354ba063cda-kube-api-access-m4rg5\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405474 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-run-netns\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405487 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f44864d-0d36-470a-92f5-3b78deac4de3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405515 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e536da72-ace0-487b-879d-126733038520-ovnkube-script-lib\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405538 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bqb2\" (UniqueName: \"kubernetes.io/projected/e536da72-ace0-487b-879d-126733038520-kube-api-access-2bqb2\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405573 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-var-lib-kubelet\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405598 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-cnibin\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405621 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-os-release\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38f08b8e-95da-4482-9d66-4ab9df185c0a-host-slash\") pod \"iptables-alerter-cv4wj\" (UID: \"38f08b8e-95da-4482-9d66-4ab9df185c0a\") " pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405670 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-etc-kubernetes\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.405873 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405699 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-run-systemd\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-sysconfig\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405765 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-run-systemd\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-conf-dir\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405845 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-systemd-units\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405811 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405875 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-kubernetes\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-socket-dir-parent\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405942 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-run-ovn\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405968 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-sys-fs\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405977 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-systemd-units\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.405994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c0694ace-bb5f-4681-baef-9117404aa775-etc-tuned\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-var-lib-cni-multus\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406034 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-run-ovn\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406046 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-log-socket\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406054 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e536da72-ace0-487b-879d-126733038520-ovnkube-script-lib\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406074 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-device-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406093 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-log-socket\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.406517 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-var-lib-kubelet\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406113 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-sys-fs\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-device-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406145 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-kubelet\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406181 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-run-openvswitch\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406206 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-modprobe-d\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406212 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-kubelet\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-run-openvswitch\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e80cafe8-be7a-42f7-8e54-49c1ce71acf1-host\") pod \"node-ca-zhzh4\" (UID: \"e80cafe8-be7a-42f7-8e54-49c1ce71acf1\") " pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f44864d-0d36-470a-92f5-3b78deac4de3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406330 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e536da72-ace0-487b-879d-126733038520-env-overrides\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406353 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gt2qx\" (UniqueName: \"kubernetes.io/projected/e7d51764-e935-4acf-a016-44f761ffb245-kube-api-access-gt2qx\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-cnibin\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406393 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e536da72-ace0-487b-879d-126733038520-ovnkube-config\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-lib-modules\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b4xq\" (UniqueName: \"kubernetes.io/projected/e80cafe8-be7a-42f7-8e54-49c1ce71acf1-kube-api-access-9b4xq\") pod \"node-ca-zhzh4\" (UID: \"e80cafe8-be7a-42f7-8e54-49c1ce71acf1\") " pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406456 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-system-cni-dir\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.407260 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406590 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-cni-dir\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-os-release\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406664 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406713 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406766 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406771 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406769 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406802 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-run-k8s-cni-cncf-io\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406830 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-var-lib-openvswitch\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406853 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-run-ovn-kubernetes\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406854 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-etc-selinux\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406899 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-run-ovn-kubernetes\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406908 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-var-lib-openvswitch\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406916 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e536da72-ace0-487b-879d-126733038520-env-overrides\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406934 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e536da72-ace0-487b-879d-126733038520-ovnkube-config\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406939 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-socket-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.406987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e80cafe8-be7a-42f7-8e54-49c1ce71acf1-serviceca\") pod \"node-ca-zhzh4\" (UID: \"e80cafe8-be7a-42f7-8e54-49c1ce71acf1\") " pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.407976 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.407011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/38f08b8e-95da-4482-9d66-4ab9df185c0a-iptables-alerter-script\") pod \"iptables-alerter-cv4wj\" (UID: \"38f08b8e-95da-4482-9d66-4ab9df185c0a\") " pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.408429 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.407030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/759ed6f5-84a7-4c03-b71e-b354ba063cda-socket-dir\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.408429 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.407043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-run-multus-certs\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.408429 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.407078 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-slash\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.408429 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.407110 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-host-slash\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.408429 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.407118 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-node-log\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.408429 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.407156 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e536da72-ace0-487b-879d-126733038520-node-log\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.408429 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.407189 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52f1d8f1-e0fd-49a9-9949-2fcbdde90afd-konnectivity-ca\") pod \"konnectivity-agent-zm6n5\" (UID: \"52f1d8f1-e0fd-49a9-9949-2fcbdde90afd\") " pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:58:48.408429 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.407702 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/52f1d8f1-e0fd-49a9-9949-2fcbdde90afd-konnectivity-ca\") pod \"konnectivity-agent-zm6n5\" (UID: \"52f1d8f1-e0fd-49a9-9949-2fcbdde90afd\") " pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:58:48.408980 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.408959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e536da72-ace0-487b-879d-126733038520-ovn-node-metrics-cert\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.409131 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.409109 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/52f1d8f1-e0fd-49a9-9949-2fcbdde90afd-agent-certs\") pod \"konnectivity-agent-zm6n5\" (UID: \"52f1d8f1-e0fd-49a9-9949-2fcbdde90afd\") " pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:58:48.413902 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:48.413855 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:58:48.413902 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:48.413883 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:58:48.413902 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:48.413896 2561 projected.go:194] Error preparing data for projected volume kube-api-access-tl742 for pod openshift-network-diagnostics/network-check-target-gxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:58:48.414111 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:48.413964 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742 podName:022aefb6-b970-4da3-b9f8-0f93b1f3847e nodeName:}" failed. No retries permitted until 2026-06-02 16:58:48.91394524 +0000 UTC m=+3.032907852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tl742" (UniqueName: "kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742") pod "network-check-target-gxp86" (UID: "022aefb6-b970-4da3-b9f8-0f93b1f3847e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:58:48.415950 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.415924 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4rg5\" (UniqueName: \"kubernetes.io/projected/759ed6f5-84a7-4c03-b71e-b354ba063cda-kube-api-access-m4rg5\") pod \"aws-ebs-csi-driver-node-qrtrz\" (UID: \"759ed6f5-84a7-4c03-b71e-b354ba063cda\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.416044 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.416006 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bqb2\" (UniqueName: \"kubernetes.io/projected/e536da72-ace0-487b-879d-126733038520-kube-api-access-2bqb2\") pod \"ovnkube-node-zx4vg\" (UID: \"e536da72-ace0-487b-879d-126733038520\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.416044 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.416017 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt2qx\" (UniqueName: \"kubernetes.io/projected/e7d51764-e935-4acf-a016-44f761ffb245-kube-api-access-gt2qx\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:48.484927 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.484895 2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:58:48.508375 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508347 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-run\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508527 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508382 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-sys\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508527 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508410 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cc1b71b-baa0-4914-8eac-a161b9d9e532-cni-binary-copy\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.508527 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508439 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-var-lib-cni-bin\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.508527 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508464 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-sysctl-d\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508527 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508470 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-run\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508527 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508488 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-system-cni-dir\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.508527 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508516 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f44864d-0d36-470a-92f5-3b78deac4de3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508535 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-var-lib-cni-bin\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508567 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-sysctl-conf\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508484 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-sys\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508625 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-system-cni-dir\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508633 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-sysctl-d\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508658 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkf9f\" (UniqueName: \"kubernetes.io/projected/c0694ace-bb5f-4681-baef-9117404aa775-kube-api-access-dkf9f\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508687 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508713 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsbd4\" (UniqueName: \"kubernetes.io/projected/4f44864d-0d36-470a-92f5-3b78deac4de3-kube-api-access-jsbd4\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-sysctl-conf\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508740 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-daemon-config\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508777 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-host\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508800 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0694ace-bb5f-4681-baef-9117404aa775-tmp\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508824 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8frp\" (UniqueName: \"kubernetes.io/projected/38f08b8e-95da-4482-9d66-4ab9df185c0a-kube-api-access-h8frp\") pod \"iptables-alerter-cv4wj\" (UID: \"38f08b8e-95da-4482-9d66-4ab9df185c0a\") " pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508853 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508855 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f44864d-0d36-470a-92f5-3b78deac4de3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508872 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-host\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.508890 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508888 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-var-lib-kubelet\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508911 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-cnibin\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508943 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-cnibin\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508954 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-var-lib-kubelet\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.508962 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-os-release\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509000 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38f08b8e-95da-4482-9d66-4ab9df185c0a-host-slash\") pod \"iptables-alerter-cv4wj\" (UID: \"38f08b8e-95da-4482-9d66-4ab9df185c0a\") " pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509028 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-etc-kubernetes\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509059 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-sysconfig\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509064 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4cc1b71b-baa0-4914-8eac-a161b9d9e532-cni-binary-copy\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509083 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-conf-dir\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509004 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4f44864d-0d36-470a-92f5-3b78deac4de3-os-release\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509109 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-kubernetes\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509121 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4f44864d-0d36-470a-92f5-3b78deac4de3-cni-binary-copy\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509134 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-socket-dir-parent\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38f08b8e-95da-4482-9d66-4ab9df185c0a-host-slash\") pod \"iptables-alerter-cv4wj\" (UID: \"38f08b8e-95da-4482-9d66-4ab9df185c0a\") " pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509179 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-socket-dir-parent\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509182 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c0694ace-bb5f-4681-baef-9117404aa775-etc-tuned\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.509686 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509188 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-sysconfig\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509215 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-var-lib-cni-multus\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-kubernetes\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509246 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-var-lib-kubelet\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509275 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-conf-dir\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509276 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-modprobe-d\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509278 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4f44864d-0d36-470a-92f5-3b78deac4de3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509272 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-etc-kubernetes\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509305 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e80cafe8-be7a-42f7-8e54-49c1ce71acf1-host\") pod \"node-ca-zhzh4\" (UID: \"e80cafe8-be7a-42f7-8e54-49c1ce71acf1\") " pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509341 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f44864d-0d36-470a-92f5-3b78deac4de3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509359 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-var-lib-kubelet\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509373 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-cnibin\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509376 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-daemon-config\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509396 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-var-lib-cni-multus\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509397 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-lib-modules\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509420 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-modprobe-d\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509434 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9b4xq\" (UniqueName: \"kubernetes.io/projected/e80cafe8-be7a-42f7-8e54-49c1ce71acf1-kube-api-access-9b4xq\") pod \"node-ca-zhzh4\" (UID: \"e80cafe8-be7a-42f7-8e54-49c1ce71acf1\") " pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509458 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-system-cni-dir\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509471 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e80cafe8-be7a-42f7-8e54-49c1ce71acf1-host\") pod \"node-ca-zhzh4\" (UID: \"e80cafe8-be7a-42f7-8e54-49c1ce71acf1\") " pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509498 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-lib-modules\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509482 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-cni-dir\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509524 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-cnibin\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509592 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-system-cni-dir\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509681 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-multus-cni-dir\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509692 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-os-release\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509731 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-run-k8s-cni-cncf-io\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509777 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e80cafe8-be7a-42f7-8e54-49c1ce71acf1-serviceca\") pod \"node-ca-zhzh4\" (UID: \"e80cafe8-be7a-42f7-8e54-49c1ce71acf1\") " pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509780 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-run-k8s-cni-cncf-io\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509800 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-os-release\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509815 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/38f08b8e-95da-4482-9d66-4ab9df185c0a-iptables-alerter-script\") pod \"iptables-alerter-cv4wj\" (UID: \"38f08b8e-95da-4482-9d66-4ab9df185c0a\") " pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509842 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4f44864d-0d36-470a-92f5-3b78deac4de3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509848 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-run-multus-certs\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-run-multus-certs\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509899 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-systemd\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509916 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-run-netns\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509931 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-hostroot\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.510813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509949 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdnsb\" (UniqueName: \"kubernetes.io/projected/4cc1b71b-baa0-4914-8eac-a161b9d9e532-kube-api-access-fdnsb\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.511392 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.509990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-host-run-netns\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.511392 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.510013 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4cc1b71b-baa0-4914-8eac-a161b9d9e532-hostroot\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.511392 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.510028 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c0694ace-bb5f-4681-baef-9117404aa775-etc-systemd\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.511392 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.510215 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e80cafe8-be7a-42f7-8e54-49c1ce71acf1-serviceca\") pod \"node-ca-zhzh4\" (UID: \"e80cafe8-be7a-42f7-8e54-49c1ce71acf1\") " pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.511392 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.510320 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/38f08b8e-95da-4482-9d66-4ab9df185c0a-iptables-alerter-script\") pod \"iptables-alerter-cv4wj\" (UID: \"38f08b8e-95da-4482-9d66-4ab9df185c0a\") " pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.511670 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.511632 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0694ace-bb5f-4681-baef-9117404aa775-tmp\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.511858 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.511841 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c0694ace-bb5f-4681-baef-9117404aa775-etc-tuned\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.520131 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.520081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8frp\" (UniqueName: \"kubernetes.io/projected/38f08b8e-95da-4482-9d66-4ab9df185c0a-kube-api-access-h8frp\") pod \"iptables-alerter-cv4wj\" (UID: \"38f08b8e-95da-4482-9d66-4ab9df185c0a\") " pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.520240 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.520217 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdnsb\" (UniqueName: \"kubernetes.io/projected/4cc1b71b-baa0-4914-8eac-a161b9d9e532-kube-api-access-fdnsb\") pod \"multus-b5z9j\" (UID: \"4cc1b71b-baa0-4914-8eac-a161b9d9e532\") " pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.520314 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.520295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsbd4\" (UniqueName: \"kubernetes.io/projected/4f44864d-0d36-470a-92f5-3b78deac4de3-kube-api-access-jsbd4\") pod \"multus-additional-cni-plugins-7kghr\" (UID: \"4f44864d-0d36-470a-92f5-3b78deac4de3\") " pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.520804 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.520779 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkf9f\" (UniqueName: \"kubernetes.io/projected/c0694ace-bb5f-4681-baef-9117404aa775-kube-api-access-dkf9f\") pod \"tuned-r4xx2\" (UID: \"c0694ace-bb5f-4681-baef-9117404aa775\") " pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.521126 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.521107 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b4xq\" (UniqueName: \"kubernetes.io/projected/e80cafe8-be7a-42f7-8e54-49c1ce71acf1-kube-api-access-9b4xq\") pod \"node-ca-zhzh4\" (UID: \"e80cafe8-be7a-42f7-8e54-49c1ce71acf1\") " pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.599233 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.599201 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:58:48.607813 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.607789 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" Jun 02 16:58:48.618415 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.618397 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:58:48.621942 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.621926 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cv4wj" Jun 02 16:58:48.629419 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.629400 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zhzh4" Jun 02 16:58:48.635963 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.635946 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" Jun 02 16:58:48.641451 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.641435 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7kghr" Jun 02 16:58:48.644966 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.644950 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b5z9j" Jun 02 16:58:48.751747 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.751723 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 16:58:48.913458 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:48.913396 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:48.913609 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:48.913507 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:58:48.913609 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:48.913566 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs podName:e7d51764-e935-4acf-a016-44f761ffb245 nodeName:}" failed. No retries permitted until 2026-06-02 16:58:49.913540238 +0000 UTC m=+4.032502830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs") pod "network-metrics-daemon-dfg6z" (UID: "e7d51764-e935-4acf-a016-44f761ffb245") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:58:48.957365 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:48.957336 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f08b8e_95da_4482_9d66_4ab9df185c0a.slice/crio-c8f537b201982eefee87992637bc8eb7954bddd37da808a4052c1e058aca7a2d WatchSource:0}: Error finding container c8f537b201982eefee87992637bc8eb7954bddd37da808a4052c1e058aca7a2d: Status 404 returned error can't find the container with id c8f537b201982eefee87992637bc8eb7954bddd37da808a4052c1e058aca7a2d Jun 02 16:58:48.958178 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:48.958154 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0694ace_bb5f_4681_baef_9117404aa775.slice/crio-50f2c1eb8022b897124eee1f84135bdeb6d8ff6afc06b0f2278a91d8e924b443 WatchSource:0}: Error finding container 50f2c1eb8022b897124eee1f84135bdeb6d8ff6afc06b0f2278a91d8e924b443: Status 404 returned error can't find the container with id 50f2c1eb8022b897124eee1f84135bdeb6d8ff6afc06b0f2278a91d8e924b443 Jun 02 16:58:48.958909 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:48.958835 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f1d8f1_e0fd_49a9_9949_2fcbdde90afd.slice/crio-db30cebe92b9e1b4d25136dabc1fc002018284a031f9f0269c1fccb14f9a93fe WatchSource:0}: Error finding container db30cebe92b9e1b4d25136dabc1fc002018284a031f9f0269c1fccb14f9a93fe: Status 404 returned error can't find the container with id db30cebe92b9e1b4d25136dabc1fc002018284a031f9f0269c1fccb14f9a93fe Jun 02 16:58:48.960338 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:48.959803 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80cafe8_be7a_42f7_8e54_49c1ce71acf1.slice/crio-0b3ed97871e24f858a5a23e99367ea9d82c806b3cfe5e1e0d34cd5b2a21773f1 WatchSource:0}: Error finding container 0b3ed97871e24f858a5a23e99367ea9d82c806b3cfe5e1e0d34cd5b2a21773f1: Status 404 returned error can't find the container with id 0b3ed97871e24f858a5a23e99367ea9d82c806b3cfe5e1e0d34cd5b2a21773f1 Jun 02 16:58:48.960819 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:48.960778 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode536da72_ace0_487b_879d_126733038520.slice/crio-1c18d1e27310b65498a4fa6457c2f4721271ce11786c0fc8e636c2743ba2d5e5 WatchSource:0}: Error finding container 1c18d1e27310b65498a4fa6457c2f4721271ce11786c0fc8e636c2743ba2d5e5: Status 404 returned error can't find the container with id 1c18d1e27310b65498a4fa6457c2f4721271ce11786c0fc8e636c2743ba2d5e5 Jun 02 16:58:48.964400 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:48.963840 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod759ed6f5_84a7_4c03_b71e_b354ba063cda.slice/crio-45bc27fb8cb5a1efae1735374367b753d33788a8c02c551a0cb98e9a1ef2a39f WatchSource:0}: Error finding container 45bc27fb8cb5a1efae1735374367b753d33788a8c02c551a0cb98e9a1ef2a39f: Status 404 returned error can't find the container with id 45bc27fb8cb5a1efae1735374367b753d33788a8c02c551a0cb98e9a1ef2a39f Jun 02 16:58:48.964400 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:48.964267 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f44864d_0d36_470a_92f5_3b78deac4de3.slice/crio-4d3e4b407551d3eea264dc5ac3d4122f385ae1eef238fa16119dcf2f4107cf07 WatchSource:0}: Error finding container 4d3e4b407551d3eea264dc5ac3d4122f385ae1eef238fa16119dcf2f4107cf07: Status 404 returned error can't find the container with id 4d3e4b407551d3eea264dc5ac3d4122f385ae1eef238fa16119dcf2f4107cf07 Jun 02 16:58:48.965623 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:58:48.965540 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc1b71b_baa0_4914_8eac_a161b9d9e532.slice/crio-c4e730a45d1dd5e510d4eecb218ba0a3b6f8331dccbef3174b607be890ff7cfc WatchSource:0}: Error finding container c4e730a45d1dd5e510d4eecb218ba0a3b6f8331dccbef3174b607be890ff7cfc: Status 404 returned error can't find the container with id c4e730a45d1dd5e510d4eecb218ba0a3b6f8331dccbef3174b607be890ff7cfc Jun 02 16:58:49.014496 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.014346 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl742\" (UniqueName: \"kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742\") pod \"network-check-target-gxp86\" (UID: \"022aefb6-b970-4da3-b9f8-0f93b1f3847e\") " pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:49.014596 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:49.014503 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:58:49.014596 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:49.014522 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:58:49.014596 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:49.014531 2561 projected.go:194] Error preparing data for projected volume kube-api-access-tl742 for pod openshift-network-diagnostics/network-check-target-gxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:58:49.014736 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:49.014606 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742 podName:022aefb6-b970-4da3-b9f8-0f93b1f3847e nodeName:}" failed. No retries permitted until 2026-06-02 16:58:50.01458663 +0000 UTC m=+4.133549237 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl742" (UniqueName: "kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742") pod "network-check-target-gxp86" (UID: "022aefb6-b970-4da3-b9f8-0f93b1f3847e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:58:49.332004 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.331948 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 16:53:47 +0000 UTC" deadline="2027-11-20 06:55:56.529260894 +0000 UTC" Jun 02 16:58:49.332004 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.331981 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12853h57m7.197283908s" Jun 02 16:58:49.399984 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.399471 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:49.399984 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:49.399620 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:58:49.426583 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.425352 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerStarted","Data":"1c18d1e27310b65498a4fa6457c2f4721271ce11786c0fc8e636c2743ba2d5e5"} Jun 02 16:58:49.429451 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.428523 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal" event={"ID":"44685aa4636debb2744cfaa33e22af42","Type":"ContainerStarted","Data":"ac546dfa05ef130aa0da46e9c12b9da4bf429617c173958ffb5e64f32d1517fa"} Jun 02 16:58:49.434452 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.434423 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7kghr" event={"ID":"4f44864d-0d36-470a-92f5-3b78deac4de3","Type":"ContainerStarted","Data":"4d3e4b407551d3eea264dc5ac3d4122f385ae1eef238fa16119dcf2f4107cf07"} Jun 02 16:58:49.445923 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.445865 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cv4wj" event={"ID":"38f08b8e-95da-4482-9d66-4ab9df185c0a","Type":"ContainerStarted","Data":"c8f537b201982eefee87992637bc8eb7954bddd37da808a4052c1e058aca7a2d"} Jun 02 16:58:49.456847 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.456739 2561 generic.go:358] "Generic (PLEG): container finished" podID="c8183951f5a54887164008dea6f76276" containerID="3f652c1bf249edd48a30659d7d0723b8a66805d0800dc08b39cb6504a42d1a73" exitCode=0 Jun 02 16:58:49.456847 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.456815 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" event={"ID":"c8183951f5a54887164008dea6f76276","Type":"ContainerDied","Data":"3f652c1bf249edd48a30659d7d0723b8a66805d0800dc08b39cb6504a42d1a73"} Jun 02 16:58:49.459631 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.459605 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b5z9j" event={"ID":"4cc1b71b-baa0-4914-8eac-a161b9d9e532","Type":"ContainerStarted","Data":"c4e730a45d1dd5e510d4eecb218ba0a3b6f8331dccbef3174b607be890ff7cfc"} Jun 02 16:58:49.463251 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.463219 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" event={"ID":"759ed6f5-84a7-4c03-b71e-b354ba063cda","Type":"ContainerStarted","Data":"45bc27fb8cb5a1efae1735374367b753d33788a8c02c551a0cb98e9a1ef2a39f"} Jun 02 16:58:49.465223 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.465096 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" event={"ID":"c0694ace-bb5f-4681-baef-9117404aa775","Type":"ContainerStarted","Data":"50f2c1eb8022b897124eee1f84135bdeb6d8ff6afc06b0f2278a91d8e924b443"} Jun 02 16:58:49.469047 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.469014 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zm6n5" event={"ID":"52f1d8f1-e0fd-49a9-9949-2fcbdde90afd","Type":"ContainerStarted","Data":"db30cebe92b9e1b4d25136dabc1fc002018284a031f9f0269c1fccb14f9a93fe"} Jun 02 16:58:49.470034 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.469984 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-118.ec2.internal" podStartSLOduration=2.469970133 podStartE2EDuration="2.469970133s" podCreationTimestamp="2026-06-02 16:58:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:58:49.449597963 +0000 UTC m=+3.568560578" watchObservedRunningTime="2026-06-02 16:58:49.469970133 +0000 UTC m=+3.588932748" Jun 02 16:58:49.472498 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.472475 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zhzh4" event={"ID":"e80cafe8-be7a-42f7-8e54-49c1ce71acf1","Type":"ContainerStarted","Data":"0b3ed97871e24f858a5a23e99367ea9d82c806b3cfe5e1e0d34cd5b2a21773f1"} Jun 02 16:58:49.922031 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:49.921762 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:49.922031 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:49.921925 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:58:49.922031 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:49.921987 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs podName:e7d51764-e935-4acf-a016-44f761ffb245 nodeName:}" failed. No retries permitted until 2026-06-02 16:58:51.921969546 +0000 UTC m=+6.040932146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs") pod "network-metrics-daemon-dfg6z" (UID: "e7d51764-e935-4acf-a016-44f761ffb245") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:58:50.023156 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:50.023063 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl742\" (UniqueName: \"kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742\") pod \"network-check-target-gxp86\" (UID: \"022aefb6-b970-4da3-b9f8-0f93b1f3847e\") " pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:50.023322 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:50.023239 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:58:50.023322 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:50.023261 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:58:50.023322 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:50.023275 2561 projected.go:194] Error preparing data for projected volume kube-api-access-tl742 for pod openshift-network-diagnostics/network-check-target-gxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:58:50.023477 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:50.023336 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742 podName:022aefb6-b970-4da3-b9f8-0f93b1f3847e nodeName:}" failed. No retries permitted until 2026-06-02 16:58:52.023316802 +0000 UTC m=+6.142279396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl742" (UniqueName: "kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742") pod "network-check-target-gxp86" (UID: "022aefb6-b970-4da3-b9f8-0f93b1f3847e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:58:50.402406 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:50.402328 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:50.402863 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:50.402449 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:58:50.492326 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:50.492189 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" event={"ID":"c8183951f5a54887164008dea6f76276","Type":"ContainerStarted","Data":"88870f69e7f78c19566a683098533d03da34845ec99e89018a5f571a8384e09a"} Jun 02 16:58:51.400495 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:51.400462 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:51.400675 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:51.400620 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:58:51.940128 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:51.940092 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:51.940622 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:51.940251 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:58:51.940622 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:51.940321 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs podName:e7d51764-e935-4acf-a016-44f761ffb245 nodeName:}" failed. No retries permitted until 2026-06-02 16:58:55.940302267 +0000 UTC m=+10.059264861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs") pod "network-metrics-daemon-dfg6z" (UID: "e7d51764-e935-4acf-a016-44f761ffb245") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:58:52.041204 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:52.041167 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl742\" (UniqueName: \"kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742\") pod \"network-check-target-gxp86\" (UID: \"022aefb6-b970-4da3-b9f8-0f93b1f3847e\") " pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:52.041390 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:52.041333 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:58:52.041390 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:52.041352 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:58:52.041390 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:52.041364 2561 projected.go:194] Error preparing data for projected volume kube-api-access-tl742 for pod openshift-network-diagnostics/network-check-target-gxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:58:52.041644 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:52.041423 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742 podName:022aefb6-b970-4da3-b9f8-0f93b1f3847e nodeName:}" failed. No retries permitted until 2026-06-02 16:58:56.041403807 +0000 UTC m=+10.160366418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl742" (UniqueName: "kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742") pod "network-check-target-gxp86" (UID: "022aefb6-b970-4da3-b9f8-0f93b1f3847e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:58:52.400299 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:52.400260 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:52.400481 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:52.400421 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:58:53.400299 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:53.400264 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:53.400807 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:53.400413 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:58:54.400544 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:54.400509 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:54.401025 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:54.400655 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:58:55.400257 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:55.400112 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:55.400257 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:55.400247 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:58:55.971969 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:55.971366 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:55.971969 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:55.971574 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:58:55.971969 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:55.971637 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs podName:e7d51764-e935-4acf-a016-44f761ffb245 nodeName:}" failed. No retries permitted until 2026-06-02 16:59:03.971619917 +0000 UTC m=+18.090582531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs") pod "network-metrics-daemon-dfg6z" (UID: "e7d51764-e935-4acf-a016-44f761ffb245") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:58:56.072853 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.072221 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl742\" (UniqueName: \"kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742\") pod \"network-check-target-gxp86\" (UID: \"022aefb6-b970-4da3-b9f8-0f93b1f3847e\") " pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:56.072853 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:56.072415 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:58:56.072853 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:56.072431 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:58:56.072853 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:56.072443 2561 projected.go:194] Error preparing data for projected volume kube-api-access-tl742 for pod openshift-network-diagnostics/network-check-target-gxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:58:56.072853 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:56.072507 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742 podName:022aefb6-b970-4da3-b9f8-0f93b1f3847e nodeName:}" failed. No retries permitted until 2026-06-02 16:59:04.072490048 +0000 UTC m=+18.191452655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl742" (UniqueName: "kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742") pod "network-check-target-gxp86" (UID: "022aefb6-b970-4da3-b9f8-0f93b1f3847e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:58:56.230419 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.229245 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-118.ec2.internal" podStartSLOduration=9.229225079 podStartE2EDuration="9.229225079s" podCreationTimestamp="2026-06-02 16:58:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:58:50.504510748 +0000 UTC m=+4.623473366" watchObservedRunningTime="2026-06-02 16:58:56.229225079 +0000 UTC m=+10.348187698" Jun 02 16:58:56.230419 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.229721 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-c6kfb"] Jun 02 16:58:56.233121 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.232819 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:56.236359 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.236337 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vdwxr\"" Jun 02 16:58:56.237367 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.236589 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 16:58:56.237367 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.236779 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 16:58:56.274582 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.274385 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8024b137-910f-4a08-8257-4ac1d69fcb73-tmp-dir\") pod \"node-resolver-c6kfb\" (UID: \"8024b137-910f-4a08-8257-4ac1d69fcb73\") " pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:56.274582 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.274490 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h662v\" (UniqueName: \"kubernetes.io/projected/8024b137-910f-4a08-8257-4ac1d69fcb73-kube-api-access-h662v\") pod \"node-resolver-c6kfb\" (UID: \"8024b137-910f-4a08-8257-4ac1d69fcb73\") " pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:56.274582 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.274572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8024b137-910f-4a08-8257-4ac1d69fcb73-hosts-file\") pod \"node-resolver-c6kfb\" (UID: \"8024b137-910f-4a08-8257-4ac1d69fcb73\") " pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:56.374950 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.374904 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8024b137-910f-4a08-8257-4ac1d69fcb73-hosts-file\") pod \"node-resolver-c6kfb\" (UID: \"8024b137-910f-4a08-8257-4ac1d69fcb73\") " pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:56.375113 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.374981 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8024b137-910f-4a08-8257-4ac1d69fcb73-tmp-dir\") pod \"node-resolver-c6kfb\" (UID: \"8024b137-910f-4a08-8257-4ac1d69fcb73\") " pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:56.375113 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.375024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8024b137-910f-4a08-8257-4ac1d69fcb73-hosts-file\") pod \"node-resolver-c6kfb\" (UID: \"8024b137-910f-4a08-8257-4ac1d69fcb73\") " pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:56.375113 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.375036 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h662v\" (UniqueName: \"kubernetes.io/projected/8024b137-910f-4a08-8257-4ac1d69fcb73-kube-api-access-h662v\") pod \"node-resolver-c6kfb\" (UID: \"8024b137-910f-4a08-8257-4ac1d69fcb73\") " pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:56.376035 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.376007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8024b137-910f-4a08-8257-4ac1d69fcb73-tmp-dir\") pod \"node-resolver-c6kfb\" (UID: \"8024b137-910f-4a08-8257-4ac1d69fcb73\") " pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:56.387220 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.387160 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h662v\" (UniqueName: \"kubernetes.io/projected/8024b137-910f-4a08-8257-4ac1d69fcb73-kube-api-access-h662v\") pod \"node-resolver-c6kfb\" (UID: \"8024b137-910f-4a08-8257-4ac1d69fcb73\") " pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:56.400527 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.400483 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:56.400674 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:56.400612 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:58:56.545767 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:56.545695 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-c6kfb" Jun 02 16:58:57.400507 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:57.400473 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:57.400952 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:57.400646 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:58:58.399960 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:58.399925 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:58:58.400200 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:58.400058 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:58:59.399880 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:58:59.399846 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:58:59.400358 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:58:59.400008 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:00.399783 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:00.399743 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:00.399934 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:00.399892 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:01.400212 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:01.400172 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:01.400675 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:01.400327 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:02.400435 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:02.400393 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:02.400921 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:02.400521 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:03.399852 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:03.399766 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:03.400043 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:03.399909 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:04.034102 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:04.034069 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:04.034528 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:04.034181 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:59:04.034528 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:04.034253 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs podName:e7d51764-e935-4acf-a016-44f761ffb245 nodeName:}" failed. No retries permitted until 2026-06-02 16:59:20.034232149 +0000 UTC m=+34.153194748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs") pod "network-metrics-daemon-dfg6z" (UID: "e7d51764-e935-4acf-a016-44f761ffb245") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:59:04.134362 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:04.134331 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl742\" (UniqueName: \"kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742\") pod \"network-check-target-gxp86\" (UID: \"022aefb6-b970-4da3-b9f8-0f93b1f3847e\") " pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:04.134513 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:04.134459 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:59:04.134513 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:04.134474 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:59:04.134513 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:04.134482 2561 projected.go:194] Error preparing data for projected volume kube-api-access-tl742 for pod openshift-network-diagnostics/network-check-target-gxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:59:04.134673 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:04.134526 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742 podName:022aefb6-b970-4da3-b9f8-0f93b1f3847e nodeName:}" failed. No retries permitted until 2026-06-02 16:59:20.134513669 +0000 UTC m=+34.253476261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl742" (UniqueName: "kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742") pod "network-check-target-gxp86" (UID: "022aefb6-b970-4da3-b9f8-0f93b1f3847e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:59:04.400316 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:04.400239 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:04.400471 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:04.400363 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:05.400235 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:05.400202 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:05.400682 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:05.400335 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:06.401395 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:06.401363 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:06.401866 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:06.401474 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:06.986882 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:59:06.986848 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8024b137_910f_4a08_8257_4ac1d69fcb73.slice/crio-4071d849c5fe7f140c6c606078ae464020fde477bf6063072cdaf0997a2cfa31 WatchSource:0}: Error finding container 4071d849c5fe7f140c6c606078ae464020fde477bf6063072cdaf0997a2cfa31: Status 404 returned error can't find the container with id 4071d849c5fe7f140c6c606078ae464020fde477bf6063072cdaf0997a2cfa31 Jun 02 16:59:07.400648 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.400371 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:07.400648 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:07.400635 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:07.521965 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.521828 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zhzh4" event={"ID":"e80cafe8-be7a-42f7-8e54-49c1ce71acf1","Type":"ContainerStarted","Data":"49417355f8b2856e1bf9ef3296aca0150deb91ee1e3cc8b7cbd592782ab7ea42"} Jun 02 16:59:07.523521 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.523495 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerStarted","Data":"ce18c244a60c249a37d6af212d136c6add640851257a0126a4d6e0650e116465"} Jun 02 16:59:07.523638 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.523528 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerStarted","Data":"9f18cc8c59af5f47ad7d0d0d2ea678f2fe5e9fe12c62927d7faab8f8ef875b48"} Jun 02 16:59:07.525280 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.525055 2561 generic.go:358] "Generic (PLEG): container finished" podID="4f44864d-0d36-470a-92f5-3b78deac4de3" containerID="e2f635a3235762e128240cf2320579d1170f678d2825c52a0cfa16504b820552" exitCode=0 Jun 02 16:59:07.525280 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.525128 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7kghr" event={"ID":"4f44864d-0d36-470a-92f5-3b78deac4de3","Type":"ContainerDied","Data":"e2f635a3235762e128240cf2320579d1170f678d2825c52a0cfa16504b820552"} Jun 02 16:59:07.526683 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.526635 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c6kfb" event={"ID":"8024b137-910f-4a08-8257-4ac1d69fcb73","Type":"ContainerStarted","Data":"f451894e16a22de66a8fb0f107a591fd8598abdb66d755a44387099d3199a51e"} Jun 02 16:59:07.526683 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.526661 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-c6kfb" event={"ID":"8024b137-910f-4a08-8257-4ac1d69fcb73","Type":"ContainerStarted","Data":"4071d849c5fe7f140c6c606078ae464020fde477bf6063072cdaf0997a2cfa31"} Jun 02 16:59:07.528499 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.528103 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b5z9j" event={"ID":"4cc1b71b-baa0-4914-8eac-a161b9d9e532","Type":"ContainerStarted","Data":"fbc35d8e8600eaa337823f9b8f3cd1076dbb47e235c1b50d08ac100614fe6fd7"} Jun 02 16:59:07.529733 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.529715 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" event={"ID":"759ed6f5-84a7-4c03-b71e-b354ba063cda","Type":"ContainerStarted","Data":"ce8633faccde9ba624bbab2f490301c05bc1af6509eea5ed7f47b33c153395c3"} Jun 02 16:59:07.531235 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.531211 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" event={"ID":"c0694ace-bb5f-4681-baef-9117404aa775","Type":"ContainerStarted","Data":"4a2d1330a84b151930b5f04252c884cba7715bdf035b5dd20536471bf22b1405"} Jun 02 16:59:07.533062 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.533042 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zm6n5" event={"ID":"52f1d8f1-e0fd-49a9-9949-2fcbdde90afd","Type":"ContainerStarted","Data":"efadd692761f78ce2ca26dbf524bfcd6bc48c0f9527c4f44e2bb65397c10f32d"} Jun 02 16:59:07.550938 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.550904 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zhzh4" podStartSLOduration=7.466966441 podStartE2EDuration="21.550893003s" podCreationTimestamp="2026-06-02 16:58:46 +0000 UTC" firstStartedPulling="2026-06-02 16:58:48.96250646 +0000 UTC m=+3.081469055" lastFinishedPulling="2026-06-02 16:59:03.046433021 +0000 UTC m=+17.165395617" observedRunningTime="2026-06-02 16:59:07.536215294 +0000 UTC m=+21.655177909" watchObservedRunningTime="2026-06-02 16:59:07.550893003 +0000 UTC m=+21.669855603" Jun 02 16:59:07.551205 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.551146 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-b5z9j" podStartSLOduration=3.506016583 podStartE2EDuration="21.551138054s" podCreationTimestamp="2026-06-02 16:58:46 +0000 UTC" firstStartedPulling="2026-06-02 16:58:48.967074848 +0000 UTC m=+3.086037446" lastFinishedPulling="2026-06-02 16:59:07.012196309 +0000 UTC m=+21.131158917" observedRunningTime="2026-06-02 16:59:07.550975111 +0000 UTC m=+21.669937725" watchObservedRunningTime="2026-06-02 16:59:07.551138054 +0000 UTC m=+21.670100672" Jun 02 16:59:07.565998 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.565946 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zm6n5" podStartSLOduration=3.543938251 podStartE2EDuration="21.565931963s" podCreationTimestamp="2026-06-02 16:58:46 +0000 UTC" firstStartedPulling="2026-06-02 16:58:48.960975219 +0000 UTC m=+3.079937813" lastFinishedPulling="2026-06-02 16:59:06.982968932 +0000 UTC m=+21.101931525" observedRunningTime="2026-06-02 16:59:07.565299215 +0000 UTC m=+21.684261821" watchObservedRunningTime="2026-06-02 16:59:07.565931963 +0000 UTC m=+21.684894581" Jun 02 16:59:07.580810 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.580776 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-c6kfb" podStartSLOduration=11.580764019 podStartE2EDuration="11.580764019s" podCreationTimestamp="2026-06-02 16:58:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 16:59:07.580477473 +0000 UTC m=+21.699440083" watchObservedRunningTime="2026-06-02 16:59:07.580764019 +0000 UTC m=+21.699726634" Jun 02 16:59:07.601005 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:07.600967 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r4xx2" podStartSLOduration=3.5756398689999997 podStartE2EDuration="21.600957842s" podCreationTimestamp="2026-06-02 16:58:46 +0000 UTC" firstStartedPulling="2026-06-02 16:58:48.960053169 +0000 UTC m=+3.079015766" lastFinishedPulling="2026-06-02 16:59:06.985371141 +0000 UTC m=+21.104333739" observedRunningTime="2026-06-02 16:59:07.600715655 +0000 UTC m=+21.719678273" watchObservedRunningTime="2026-06-02 16:59:07.600957842 +0000 UTC m=+21.719920457" Jun 02 16:59:08.245353 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.245314 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 16:59:08.376268 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.376177 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T16:59:08.245334209Z","UUID":"00afbed7-6ea0-498f-aec1-da1e5c64806f","Handler":null,"Name":"","Endpoint":""} Jun 02 16:59:08.379437 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.379414 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 16:59:08.379594 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.379444 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 16:59:08.399994 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.399962 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:08.400114 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:08.400097 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:08.537995 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.537931 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 16:59:08.538351 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.538317 2561 generic.go:358] "Generic (PLEG): container finished" podID="e536da72-ace0-487b-879d-126733038520" containerID="ce18c244a60c249a37d6af212d136c6add640851257a0126a4d6e0650e116465" exitCode=1 Jun 02 16:59:08.538420 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.538398 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerDied","Data":"ce18c244a60c249a37d6af212d136c6add640851257a0126a4d6e0650e116465"} Jun 02 16:59:08.538479 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.538435 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerStarted","Data":"6cd9926d2f8b826a0105a78cc5fd220d35e3195c3b2752b24febbc096d87f86d"} Jun 02 16:59:08.538479 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.538450 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerStarted","Data":"3777483f61d392bad1f04a24d3139665edb2c0cd7c8df86582f31663cdc286b6"} Jun 02 16:59:08.538479 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.538463 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerStarted","Data":"cab25de0478c09331028f033706ffc82889b514d52ee28d797e6d02eb15414de"} Jun 02 16:59:08.538479 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.538475 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerStarted","Data":"956fcf53ce06439c67f24e5980b64326a3bf567cdbafc5e3dbfe19f78a2236c6"} Jun 02 16:59:08.539849 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.539817 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cv4wj" event={"ID":"38f08b8e-95da-4482-9d66-4ab9df185c0a","Type":"ContainerStarted","Data":"b18e8f00ee5a11cd6443a7be9cc2083eb72522cfeff0ea70b25f4de8dcd64ff5"} Jun 02 16:59:08.541585 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.541542 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" event={"ID":"759ed6f5-84a7-4c03-b71e-b354ba063cda","Type":"ContainerStarted","Data":"65c4a4a56a8460b77c39a035fafb79257f2369c82fa01c6503105b696a82ef96"} Jun 02 16:59:08.554712 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:08.554674 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cv4wj" podStartSLOduration=4.530885706 podStartE2EDuration="22.554662546s" podCreationTimestamp="2026-06-02 16:58:46 +0000 UTC" firstStartedPulling="2026-06-02 16:58:48.959199689 +0000 UTC m=+3.078162288" lastFinishedPulling="2026-06-02 16:59:06.98297653 +0000 UTC m=+21.101939128" observedRunningTime="2026-06-02 16:59:08.554387316 +0000 UTC m=+22.673349932" watchObservedRunningTime="2026-06-02 16:59:08.554662546 +0000 UTC m=+22.673625160" Jun 02 16:59:09.400574 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:09.400378 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:09.400720 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:09.400680 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:09.545110 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:09.545025 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" event={"ID":"759ed6f5-84a7-4c03-b71e-b354ba063cda","Type":"ContainerStarted","Data":"dfbd2533a40679062c5fc1203cbcb69e540e764f42dc3ca6da54fe178674b071"} Jun 02 16:59:09.563373 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:09.563321 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qrtrz" podStartSLOduration=3.312150119 podStartE2EDuration="23.563304346s" podCreationTimestamp="2026-06-02 16:58:46 +0000 UTC" firstStartedPulling="2026-06-02 16:58:48.965848224 +0000 UTC m=+3.084810820" lastFinishedPulling="2026-06-02 16:59:09.217002451 +0000 UTC m=+23.335965047" observedRunningTime="2026-06-02 16:59:09.562962355 +0000 UTC m=+23.681924974" watchObservedRunningTime="2026-06-02 16:59:09.563304346 +0000 UTC m=+23.682266962" Jun 02 16:59:10.399844 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:10.399773 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:10.399995 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:10.399873 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:10.548809 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:10.548778 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 16:59:10.549203 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:10.549126 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerStarted","Data":"6774e900ea14a87da82ce4b64da262dd9e6a584c107e2ed872dd3270fe16cff0"} Jun 02 16:59:10.865154 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:10.865124 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:59:10.865679 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:10.865659 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:59:11.399449 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:11.399416 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:11.399644 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:11.399540 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:11.551328 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:11.551295 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:59:11.551905 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:11.551818 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zm6n5" Jun 02 16:59:12.400338 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:12.400305 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:12.400515 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:12.400426 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:12.557489 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:12.557297 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 16:59:12.558090 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:12.557983 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerStarted","Data":"5031f38d05ddd5536b75962a9d089d35e55dd9e961e3a6627bbb742f0c673f69"} Jun 02 16:59:12.558431 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:12.558407 2561 scope.go:117] "RemoveContainer" containerID="ce18c244a60c249a37d6af212d136c6add640851257a0126a4d6e0650e116465" Jun 02 16:59:13.399893 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.399867 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:13.400052 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:13.399963 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:13.561005 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.560976 2561 generic.go:358] "Generic (PLEG): container finished" podID="4f44864d-0d36-470a-92f5-3b78deac4de3" containerID="3f93a2dbe597f4607c8a94c395a4dfc6565f486838fced9237068c08099fdd8c" exitCode=0 Jun 02 16:59:13.561355 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.561069 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7kghr" event={"ID":"4f44864d-0d36-470a-92f5-3b78deac4de3","Type":"ContainerDied","Data":"3f93a2dbe597f4607c8a94c395a4dfc6565f486838fced9237068c08099fdd8c"} Jun 02 16:59:13.564188 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.564174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 16:59:13.564476 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.564444 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" event={"ID":"e536da72-ace0-487b-879d-126733038520","Type":"ContainerStarted","Data":"aa386c77bcd94e843fa6392b564f01e4c6094cf96a8d0dfee8f6ee6007d6ee56"} Jun 02 16:59:13.564798 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.564781 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 16:59:13.565066 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.565043 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:59:13.565066 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.565067 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:59:13.580968 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.580948 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:59:13.581110 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.581098 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:59:13.612502 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:13.612463 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" podStartSLOduration=9.244483009 podStartE2EDuration="27.612453298s" podCreationTimestamp="2026-06-02 16:58:46 +0000 UTC" firstStartedPulling="2026-06-02 16:58:48.963127924 +0000 UTC m=+3.082090520" lastFinishedPulling="2026-06-02 16:59:07.331098216 +0000 UTC m=+21.450060809" observedRunningTime="2026-06-02 16:59:13.612025307 +0000 UTC m=+27.730987924" watchObservedRunningTime="2026-06-02 16:59:13.612453298 +0000 UTC m=+27.731415910" Jun 02 16:59:14.400115 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:14.399969 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:14.400216 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:14.400184 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:14.435027 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:14.435000 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dfg6z"] Jun 02 16:59:14.435151 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:14.435138 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:14.435276 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:14.435255 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:14.437585 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:14.437564 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gxp86"] Jun 02 16:59:14.568223 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:14.568143 2561 generic.go:358] "Generic (PLEG): container finished" podID="4f44864d-0d36-470a-92f5-3b78deac4de3" containerID="10bcbabef8927c2d4905723a2d9124a6d7ebf6a0b3587f02fa1e32ca8a59d27e" exitCode=0 Jun 02 16:59:14.568223 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:14.568208 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7kghr" event={"ID":"4f44864d-0d36-470a-92f5-3b78deac4de3","Type":"ContainerDied","Data":"10bcbabef8927c2d4905723a2d9124a6d7ebf6a0b3587f02fa1e32ca8a59d27e"} Jun 02 16:59:14.568703 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:14.568230 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:14.568703 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:14.568335 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:14.568703 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:14.568609 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 16:59:15.572125 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:15.572095 2561 generic.go:358] "Generic (PLEG): container finished" podID="4f44864d-0d36-470a-92f5-3b78deac4de3" containerID="5f95ee2793745af696c63dada9000c3a52769908aacfd940012da5bca0bfea57" exitCode=0 Jun 02 16:59:15.572481 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:15.572188 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7kghr" event={"ID":"4f44864d-0d36-470a-92f5-3b78deac4de3","Type":"ContainerDied","Data":"5f95ee2793745af696c63dada9000c3a52769908aacfd940012da5bca0bfea57"} Jun 02 16:59:15.572481 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:15.572249 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 16:59:16.400656 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:16.400621 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:16.400808 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:16.400733 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:16.400951 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:16.400921 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:16.401057 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:16.401040 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:17.738234 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:17.738200 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:59:17.739016 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:17.738460 2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 16:59:17.749066 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:17.749023 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" podUID="e536da72-ace0-487b-879d-126733038520" containerName="ovnkube-controller" probeResult="failure" output="" Jun 02 16:59:17.758784 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:17.758751 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" podUID="e536da72-ace0-487b-879d-126733038520" containerName="ovnkube-controller" probeResult="failure" output="" Jun 02 16:59:18.400275 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:18.400248 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:18.400444 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:18.400378 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:18.400444 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:18.400430 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:18.400858 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:18.400826 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:20.059745 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.059714 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:20.060360 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.059868 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:59:20.060360 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.059942 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs podName:e7d51764-e935-4acf-a016-44f761ffb245 nodeName:}" failed. No retries permitted until 2026-06-02 16:59:52.059919833 +0000 UTC m=+66.178882433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs") pod "network-metrics-daemon-dfg6z" (UID: "e7d51764-e935-4acf-a016-44f761ffb245") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 16:59:20.161134 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.161097 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl742\" (UniqueName: \"kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742\") pod \"network-check-target-gxp86\" (UID: \"022aefb6-b970-4da3-b9f8-0f93b1f3847e\") " pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:20.161318 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.161269 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 16:59:20.161318 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.161302 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 16:59:20.161318 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.161315 2561 projected.go:194] Error preparing data for projected volume kube-api-access-tl742 for pod openshift-network-diagnostics/network-check-target-gxp86: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:59:20.161480 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.161374 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742 podName:022aefb6-b970-4da3-b9f8-0f93b1f3847e nodeName:}" failed. No retries permitted until 2026-06-02 16:59:52.161356026 +0000 UTC m=+66.280318636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tl742" (UniqueName: "kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742") pod "network-check-target-gxp86" (UID: "022aefb6-b970-4da3-b9f8-0f93b1f3847e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 16:59:20.400255 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.400174 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:20.400255 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.400198 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:20.400450 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.400333 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gxp86" podUID="022aefb6-b970-4da3-b9f8-0f93b1f3847e" Jun 02 16:59:20.400498 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.400475 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 16:59:20.663050 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.662974 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-118.ec2.internal" event="NodeReady" Jun 02 16:59:20.663195 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.663126 2561 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 16:59:20.725802 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.725773 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w4rwh"] Jun 02 16:59:20.753563 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.753521 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jjcp4"] Jun 02 16:59:20.753719 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.753698 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.756495 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.756470 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 16:59:20.756654 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.756523 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 16:59:20.756654 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.756617 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nfxvm\"" Jun 02 16:59:20.768582 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.768562 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w4rwh"] Jun 02 16:59:20.768688 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.768588 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jjcp4"] Jun 02 16:59:20.768688 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.768652 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:20.771543 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.771501 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 16:59:20.771749 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.771728 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x4vx8\"" Jun 02 16:59:20.771801 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.771782 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 16:59:20.772040 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.772021 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 16:59:20.867025 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.866982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08960404-6b30-4974-a440-37b70c47fbe9-config-volume\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.867198 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.867031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvzxr\" (UniqueName: \"kubernetes.io/projected/08960404-6b30-4974-a440-37b70c47fbe9-kube-api-access-pvzxr\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.867198 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.867131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldd9\" (UniqueName: \"kubernetes.io/projected/c30e571f-e427-448b-a305-f0a1c032bbcc-kube-api-access-5ldd9\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:20.867198 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.867182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:20.867345 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.867212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08960404-6b30-4974-a440-37b70c47fbe9-tmp-dir\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.867345 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.867253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.968337 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.968298 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pvzxr\" (UniqueName: \"kubernetes.io/projected/08960404-6b30-4974-a440-37b70c47fbe9-kube-api-access-pvzxr\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.968496 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.968357 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldd9\" (UniqueName: \"kubernetes.io/projected/c30e571f-e427-448b-a305-f0a1c032bbcc-kube-api-access-5ldd9\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:20.968584 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.968521 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:20.968584 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.968572 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08960404-6b30-4974-a440-37b70c47fbe9-tmp-dir\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.968702 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.968617 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.968702 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.968639 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:59:20.968702 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.968662 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08960404-6b30-4974-a440-37b70c47fbe9-config-volume\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.968702 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.968701 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert podName:c30e571f-e427-448b-a305-f0a1c032bbcc nodeName:}" failed. No retries permitted until 2026-06-02 16:59:21.46868147 +0000 UTC m=+35.587644079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert") pod "ingress-canary-jjcp4" (UID: "c30e571f-e427-448b-a305-f0a1c032bbcc") : secret "canary-serving-cert" not found Jun 02 16:59:20.968885 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.968762 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:59:20.968885 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:20.968817 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls podName:08960404-6b30-4974-a440-37b70c47fbe9 nodeName:}" failed. No retries permitted until 2026-06-02 16:59:21.468799574 +0000 UTC m=+35.587762170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls") pod "dns-default-w4rwh" (UID: "08960404-6b30-4974-a440-37b70c47fbe9") : secret "dns-default-metrics-tls" not found Jun 02 16:59:20.968952 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.968900 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/08960404-6b30-4974-a440-37b70c47fbe9-tmp-dir\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.969215 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.969197 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/08960404-6b30-4974-a440-37b70c47fbe9-config-volume\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.982863 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.982700 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvzxr\" (UniqueName: \"kubernetes.io/projected/08960404-6b30-4974-a440-37b70c47fbe9-kube-api-access-pvzxr\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:20.982974 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:20.982737 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldd9\" (UniqueName: \"kubernetes.io/projected/c30e571f-e427-448b-a305-f0a1c032bbcc-kube-api-access-5ldd9\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:21.473993 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:21.473948 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:21.474408 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:21.474050 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:21.474408 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:21.474110 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:59:21.474408 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:21.474144 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:59:21.474408 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:21.474188 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls podName:08960404-6b30-4974-a440-37b70c47fbe9 nodeName:}" failed. No retries permitted until 2026-06-02 16:59:22.474165539 +0000 UTC m=+36.593128138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls") pod "dns-default-w4rwh" (UID: "08960404-6b30-4974-a440-37b70c47fbe9") : secret "dns-default-metrics-tls" not found Jun 02 16:59:21.474408 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:21.474208 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert podName:c30e571f-e427-448b-a305-f0a1c032bbcc nodeName:}" failed. No retries permitted until 2026-06-02 16:59:22.474198361 +0000 UTC m=+36.593160960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert") pod "ingress-canary-jjcp4" (UID: "c30e571f-e427-448b-a305-f0a1c032bbcc") : secret "canary-serving-cert" not found Jun 02 16:59:22.400333 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.400304 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:22.400477 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.400304 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:22.404467 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.404437 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 16:59:22.404618 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.404485 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 16:59:22.404618 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.404455 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z9hk5\"" Jun 02 16:59:22.404618 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.404455 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t5b29\"" Jun 02 16:59:22.404618 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.404528 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 16:59:22.480610 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.480589 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:22.480950 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.480633 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:22.480950 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:22.480769 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:59:22.480950 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:22.480783 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:59:22.480950 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:22.480844 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert podName:c30e571f-e427-448b-a305-f0a1c032bbcc nodeName:}" failed. No retries permitted until 2026-06-02 16:59:24.480826146 +0000 UTC m=+38.599788754 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert") pod "ingress-canary-jjcp4" (UID: "c30e571f-e427-448b-a305-f0a1c032bbcc") : secret "canary-serving-cert" not found Jun 02 16:59:22.480950 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:22.480858 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls podName:08960404-6b30-4974-a440-37b70c47fbe9 nodeName:}" failed. No retries permitted until 2026-06-02 16:59:24.480852589 +0000 UTC m=+38.599815181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls") pod "dns-default-w4rwh" (UID: "08960404-6b30-4974-a440-37b70c47fbe9") : secret "dns-default-metrics-tls" not found Jun 02 16:59:22.590065 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.590041 2561 generic.go:358] "Generic (PLEG): container finished" podID="4f44864d-0d36-470a-92f5-3b78deac4de3" containerID="ac9f1cdf60917d24f43404bfa6446fe6d75ccdd03a83967b09f694a6c5f97dd7" exitCode=0 Jun 02 16:59:22.590174 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:22.590078 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7kghr" event={"ID":"4f44864d-0d36-470a-92f5-3b78deac4de3","Type":"ContainerDied","Data":"ac9f1cdf60917d24f43404bfa6446fe6d75ccdd03a83967b09f694a6c5f97dd7"} Jun 02 16:59:23.593961 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:23.593925 2561 generic.go:358] "Generic (PLEG): container finished" podID="4f44864d-0d36-470a-92f5-3b78deac4de3" containerID="536d571ea0265a3888b3c40a3c2d545ea311b4bbd38663bf527ee41339804736" exitCode=0 Jun 02 16:59:23.594301 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:23.593987 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7kghr" event={"ID":"4f44864d-0d36-470a-92f5-3b78deac4de3","Type":"ContainerDied","Data":"536d571ea0265a3888b3c40a3c2d545ea311b4bbd38663bf527ee41339804736"} Jun 02 16:59:24.496738 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:24.496712 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:24.496866 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:24.496747 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:24.496866 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:24.496846 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:59:24.496958 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:24.496846 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:59:24.496958 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:24.496887 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls podName:08960404-6b30-4974-a440-37b70c47fbe9 nodeName:}" failed. No retries permitted until 2026-06-02 16:59:28.496874196 +0000 UTC m=+42.615836789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls") pod "dns-default-w4rwh" (UID: "08960404-6b30-4974-a440-37b70c47fbe9") : secret "dns-default-metrics-tls" not found Jun 02 16:59:24.496958 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:24.496939 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert podName:c30e571f-e427-448b-a305-f0a1c032bbcc nodeName:}" failed. No retries permitted until 2026-06-02 16:59:28.496920399 +0000 UTC m=+42.615882996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert") pod "ingress-canary-jjcp4" (UID: "c30e571f-e427-448b-a305-f0a1c032bbcc") : secret "canary-serving-cert" not found Jun 02 16:59:24.598287 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:24.598259 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7kghr" event={"ID":"4f44864d-0d36-470a-92f5-3b78deac4de3","Type":"ContainerStarted","Data":"391deb3092c36bd94bba7c976860dcc8b931908eb2b9173519de410e22f2a833"} Jun 02 16:59:24.621368 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:24.621324 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7kghr" podStartSLOduration=5.376792952 podStartE2EDuration="38.621311927s" podCreationTimestamp="2026-06-02 16:58:46 +0000 UTC" firstStartedPulling="2026-06-02 16:58:48.96606134 +0000 UTC m=+3.085023946" lastFinishedPulling="2026-06-02 16:59:22.210580328 +0000 UTC m=+36.329542921" observedRunningTime="2026-06-02 16:59:24.619499347 +0000 UTC m=+38.738461961" watchObservedRunningTime="2026-06-02 16:59:24.621311927 +0000 UTC m=+38.740274588" Jun 02 16:59:28.526036 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:28.526004 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:28.526507 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:28.526045 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:28.526507 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:28.526147 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:59:28.526507 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:28.526209 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert podName:c30e571f-e427-448b-a305-f0a1c032bbcc nodeName:}" failed. No retries permitted until 2026-06-02 16:59:36.526194496 +0000 UTC m=+50.645157090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert") pod "ingress-canary-jjcp4" (UID: "c30e571f-e427-448b-a305-f0a1c032bbcc") : secret "canary-serving-cert" not found Jun 02 16:59:28.526507 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:28.526152 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:59:28.526507 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:28.526287 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls podName:08960404-6b30-4974-a440-37b70c47fbe9 nodeName:}" failed. No retries permitted until 2026-06-02 16:59:36.526266935 +0000 UTC m=+50.645229545 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls") pod "dns-default-w4rwh" (UID: "08960404-6b30-4974-a440-37b70c47fbe9") : secret "dns-default-metrics-tls" not found Jun 02 16:59:36.573083 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:36.573051 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:36.573083 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:36.573089 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:36.573573 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:36.573181 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:59:36.573573 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:36.573196 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:59:36.573573 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:36.573234 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls podName:08960404-6b30-4974-a440-37b70c47fbe9 nodeName:}" failed. No retries permitted until 2026-06-02 16:59:52.573218014 +0000 UTC m=+66.692180608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls") pod "dns-default-w4rwh" (UID: "08960404-6b30-4974-a440-37b70c47fbe9") : secret "dns-default-metrics-tls" not found Jun 02 16:59:36.573573 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:36.573275 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert podName:c30e571f-e427-448b-a305-f0a1c032bbcc nodeName:}" failed. No retries permitted until 2026-06-02 16:59:52.573260995 +0000 UTC m=+66.692223587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert") pod "ingress-canary-jjcp4" (UID: "c30e571f-e427-448b-a305-f0a1c032bbcc") : secret "canary-serving-cert" not found Jun 02 16:59:47.758578 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:47.758521 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx4vg" Jun 02 16:59:52.073436 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.073399 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 16:59:52.076315 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.076293 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 16:59:52.084633 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:52.084608 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 16:59:52.084723 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:52.084681 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs podName:e7d51764-e935-4acf-a016-44f761ffb245 nodeName:}" failed. No retries permitted until 2026-06-02 17:00:56.084664655 +0000 UTC m=+130.203627253 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs") pod "network-metrics-daemon-dfg6z" (UID: "e7d51764-e935-4acf-a016-44f761ffb245") : secret "metrics-daemon-secret" not found Jun 02 16:59:52.174335 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.174302 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl742\" (UniqueName: \"kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742\") pod \"network-check-target-gxp86\" (UID: \"022aefb6-b970-4da3-b9f8-0f93b1f3847e\") " pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:52.177518 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.177499 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 16:59:52.187246 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.187227 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 16:59:52.198707 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.198683 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl742\" (UniqueName: \"kubernetes.io/projected/022aefb6-b970-4da3-b9f8-0f93b1f3847e-kube-api-access-tl742\") pod \"network-check-target-gxp86\" (UID: \"022aefb6-b970-4da3-b9f8-0f93b1f3847e\") " pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:52.417145 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.417082 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z9hk5\"" Jun 02 16:59:52.425297 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.425274 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:52.577015 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.576981 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 16:59:52.577138 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.577027 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 16:59:52.577138 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:52.577121 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 16:59:52.577206 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:52.577179 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert podName:c30e571f-e427-448b-a305-f0a1c032bbcc nodeName:}" failed. No retries permitted until 2026-06-02 17:00:24.577162669 +0000 UTC m=+98.696125467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert") pod "ingress-canary-jjcp4" (UID: "c30e571f-e427-448b-a305-f0a1c032bbcc") : secret "canary-serving-cert" not found Jun 02 16:59:52.577206 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:52.577179 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 16:59:52.577276 ip-10-0-143-118 kubenswrapper[2561]: E0602 16:59:52.577247 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls podName:08960404-6b30-4974-a440-37b70c47fbe9 nodeName:}" failed. No retries permitted until 2026-06-02 17:00:24.57723364 +0000 UTC m=+98.696196233 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls") pod "dns-default-w4rwh" (UID: "08960404-6b30-4974-a440-37b70c47fbe9") : secret "dns-default-metrics-tls" not found Jun 02 16:59:52.585409 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.585387 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gxp86"] Jun 02 16:59:52.588504 ip-10-0-143-118 kubenswrapper[2561]: W0602 16:59:52.588481 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod022aefb6_b970_4da3_b9f8_0f93b1f3847e.slice/crio-17d31801e66f6976281576a3db988ceeb825ac0ee77e248169e95627d44dbecb WatchSource:0}: Error finding container 17d31801e66f6976281576a3db988ceeb825ac0ee77e248169e95627d44dbecb: Status 404 returned error can't find the container with id 17d31801e66f6976281576a3db988ceeb825ac0ee77e248169e95627d44dbecb Jun 02 16:59:52.650355 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:52.650334 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gxp86" event={"ID":"022aefb6-b970-4da3-b9f8-0f93b1f3847e","Type":"ContainerStarted","Data":"17d31801e66f6976281576a3db988ceeb825ac0ee77e248169e95627d44dbecb"} Jun 02 16:59:55.656331 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:55.656306 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gxp86" event={"ID":"022aefb6-b970-4da3-b9f8-0f93b1f3847e","Type":"ContainerStarted","Data":"752949ba0e3662f10f7f137ae14127fee07b69f134307124ff9ea51d922d8735"} Jun 02 16:59:55.656657 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:55.656449 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 16:59:55.671650 ip-10-0-143-118 kubenswrapper[2561]: I0602 16:59:55.671611 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gxp86" podStartSLOduration=66.71542578 podStartE2EDuration="1m9.671599814s" podCreationTimestamp="2026-06-02 16:58:46 +0000 UTC" firstStartedPulling="2026-06-02 16:59:52.590336258 +0000 UTC m=+66.709298865" lastFinishedPulling="2026-06-02 16:59:55.546510295 +0000 UTC m=+69.665472899" observedRunningTime="2026-06-02 16:59:55.66987144 +0000 UTC m=+69.788834055" watchObservedRunningTime="2026-06-02 16:59:55.671599814 +0000 UTC m=+69.790562428" Jun 02 17:00:24.580790 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:00:24.580748 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 17:00:24.580790 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:00:24.580801 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 17:00:24.581233 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:00:24.580900 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 17:00:24.581233 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:00:24.580964 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls podName:08960404-6b30-4974-a440-37b70c47fbe9 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:28.580950111 +0000 UTC m=+162.699912704 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls") pod "dns-default-w4rwh" (UID: "08960404-6b30-4974-a440-37b70c47fbe9") : secret "dns-default-metrics-tls" not found Jun 02 17:00:24.581233 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:00:24.580900 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 17:00:24.581233 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:00:24.581036 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert podName:c30e571f-e427-448b-a305-f0a1c032bbcc nodeName:}" failed. No retries permitted until 2026-06-02 17:01:28.581024499 +0000 UTC m=+162.699987096 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert") pod "ingress-canary-jjcp4" (UID: "c30e571f-e427-448b-a305-f0a1c032bbcc") : secret "canary-serving-cert" not found Jun 02 17:00:26.660274 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:00:26.660245 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gxp86" Jun 02 17:00:56.085960 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:00:56.085910 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 17:00:56.086453 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:00:56.086059 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 17:00:56.086453 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:00:56.086125 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs podName:e7d51764-e935-4acf-a016-44f761ffb245 nodeName:}" failed. No retries permitted until 2026-06-02 17:02:58.086108165 +0000 UTC m=+252.205070757 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs") pod "network-metrics-daemon-dfg6z" (UID: "e7d51764-e935-4acf-a016-44f761ffb245") : secret "metrics-daemon-secret" not found Jun 02 17:01:02.012760 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.012724 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg"] Jun 02 17:01:02.015529 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.015515 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:02.018163 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.018141 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 17:01:02.018286 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.018142 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 17:01:02.018286 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.018148 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 17:01:02.021500 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.021121 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 17:01:02.021500 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.021220 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cd2mk\"" Jun 02 17:01:02.024402 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.024384 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg"] Jun 02 17:01:02.126627 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.126594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9e02be24-e73f-4062-9f3d-d12e25f01d30-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:02.126792 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.126648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:02.126792 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.126671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb7pn\" (UniqueName: \"kubernetes.io/projected/9e02be24-e73f-4062-9f3d-d12e25f01d30-kube-api-access-gb7pn\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:02.212757 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.212728 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-wg6tm"] Jun 02 17:01:02.215481 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.215465 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.218342 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.218321 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 17:01:02.218467 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.218372 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 17:01:02.218467 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.218416 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 17:01:02.218467 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.218454 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7d7jv\"" Jun 02 17:01:02.218769 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.218753 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 17:01:02.223183 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.223164 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 17:01:02.227208 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.227189 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-wg6tm"] Jun 02 17:01:02.227367 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.227350 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9e02be24-e73f-4062-9f3d-d12e25f01d30-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:02.227409 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.227387 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:02.227452 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.227409 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gb7pn\" (UniqueName: \"kubernetes.io/projected/9e02be24-e73f-4062-9f3d-d12e25f01d30-kube-api-access-gb7pn\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:02.227516 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:02.227502 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:02.227596 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:02.227585 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls podName:9e02be24-e73f-4062-9f3d-d12e25f01d30 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:02.727566576 +0000 UTC m=+136.846529184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-4cxmg" (UID: "9e02be24-e73f-4062-9f3d-d12e25f01d30") : secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:02.227987 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.227971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9e02be24-e73f-4062-9f3d-d12e25f01d30-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:02.243641 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.243623 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb7pn\" (UniqueName: \"kubernetes.io/projected/9e02be24-e73f-4062-9f3d-d12e25f01d30-kube-api-access-gb7pn\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:02.328531 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.328484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17b93277-b713-4313-a736-79af364b1c86-serving-cert\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.328531 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.328533 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17b93277-b713-4313-a736-79af364b1c86-tmp\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.328700 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.328566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17b93277-b713-4313-a736-79af364b1c86-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.328700 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.328645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17b93277-b713-4313-a736-79af364b1c86-service-ca-bundle\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.328700 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.328690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/17b93277-b713-4313-a736-79af364b1c86-snapshots\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.328850 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.328779 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz56c\" (UniqueName: \"kubernetes.io/projected/17b93277-b713-4313-a736-79af364b1c86-kube-api-access-dz56c\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.429610 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.429582 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dz56c\" (UniqueName: \"kubernetes.io/projected/17b93277-b713-4313-a736-79af364b1c86-kube-api-access-dz56c\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.429724 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.429617 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17b93277-b713-4313-a736-79af364b1c86-serving-cert\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.429724 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.429662 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17b93277-b713-4313-a736-79af364b1c86-tmp\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.429724 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.429689 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17b93277-b713-4313-a736-79af364b1c86-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.429858 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.429736 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17b93277-b713-4313-a736-79af364b1c86-service-ca-bundle\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.430260 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.430229 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/17b93277-b713-4313-a736-79af364b1c86-snapshots\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.430372 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.430357 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17b93277-b713-4313-a736-79af364b1c86-tmp\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.430657 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.430634 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17b93277-b713-4313-a736-79af364b1c86-service-ca-bundle\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.431003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.430979 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17b93277-b713-4313-a736-79af364b1c86-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.431136 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.431118 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/17b93277-b713-4313-a736-79af364b1c86-snapshots\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.434463 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.434443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17b93277-b713-4313-a736-79af364b1c86-serving-cert\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.437325 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.437307 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz56c\" (UniqueName: \"kubernetes.io/projected/17b93277-b713-4313-a736-79af364b1c86-kube-api-access-dz56c\") pod \"insights-operator-788bf58df5-wg6tm\" (UID: \"17b93277-b713-4313-a736-79af364b1c86\") " pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.524809 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.524774 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-wg6tm" Jun 02 17:01:02.635029 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.634994 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-wg6tm"] Jun 02 17:01:02.637684 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:02.637661 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b93277_b713_4313_a736_79af364b1c86.slice/crio-bad06c5db64d06a884a9f1a6e361c2213a4029dcc8498cf99c1f2b0ee5bac74f WatchSource:0}: Error finding container bad06c5db64d06a884a9f1a6e361c2213a4029dcc8498cf99c1f2b0ee5bac74f: Status 404 returned error can't find the container with id bad06c5db64d06a884a9f1a6e361c2213a4029dcc8498cf99c1f2b0ee5bac74f Jun 02 17:01:02.732700 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.732665 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:02.732827 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:02.732811 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:02.732887 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:02.732882 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls podName:9e02be24-e73f-4062-9f3d-d12e25f01d30 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:03.732862629 +0000 UTC m=+137.851825225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-4cxmg" (UID: "9e02be24-e73f-4062-9f3d-d12e25f01d30") : secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:02.777067 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:02.777036 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-wg6tm" event={"ID":"17b93277-b713-4313-a736-79af364b1c86","Type":"ContainerStarted","Data":"bad06c5db64d06a884a9f1a6e361c2213a4029dcc8498cf99c1f2b0ee5bac74f"} Jun 02 17:01:03.741751 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:03.741718 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:03.742155 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:03.741847 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:03.742155 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:03.741920 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls podName:9e02be24-e73f-4062-9f3d-d12e25f01d30 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:05.741905857 +0000 UTC m=+139.860868450 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-4cxmg" (UID: "9e02be24-e73f-4062-9f3d-d12e25f01d30") : secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:04.781857 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:04.781815 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-wg6tm" event={"ID":"17b93277-b713-4313-a736-79af364b1c86","Type":"ContainerStarted","Data":"7ee2a70393867954e9844c18fed76a81a04bd9260103ca9d588d8f08c3fce4f5"} Jun 02 17:01:04.799061 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:04.799010 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-wg6tm" podStartSLOduration=0.865883893 podStartE2EDuration="2.798997482s" podCreationTimestamp="2026-06-02 17:01:02 +0000 UTC" firstStartedPulling="2026-06-02 17:01:02.639308226 +0000 UTC m=+136.758270832" lastFinishedPulling="2026-06-02 17:01:04.572421813 +0000 UTC m=+138.691384421" observedRunningTime="2026-06-02 17:01:04.798599825 +0000 UTC m=+138.917562441" watchObservedRunningTime="2026-06-02 17:01:04.798997482 +0000 UTC m=+138.917960096" Jun 02 17:01:05.755813 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:05.755780 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:05.755978 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:05.755894 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:05.755978 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:05.755949 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls podName:9e02be24-e73f-4062-9f3d-d12e25f01d30 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:09.755935898 +0000 UTC m=+143.874898491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-4cxmg" (UID: "9e02be24-e73f-4062-9f3d-d12e25f01d30") : secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:07.508064 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:07.508040 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6kfb_8024b137-910f-4a08-8257-4ac1d69fcb73/dns-node-resolver/0.log" Jun 02 17:01:08.907513 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:08.907484 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zhzh4_e80cafe8-be7a-42f7-8e54-49c1ce71acf1/node-ca/0.log" Jun 02 17:01:09.783258 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:09.783223 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:09.783421 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:09.783343 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:09.783421 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:09.783393 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls podName:9e02be24-e73f-4062-9f3d-d12e25f01d30 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:17.783377622 +0000 UTC m=+151.902340215 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-4cxmg" (UID: "9e02be24-e73f-4062-9f3d-d12e25f01d30") : secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:11.993439 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:11.993411 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7"] Jun 02 17:01:11.996365 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:11.996345 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:11.999423 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:11.999403 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 17:01:11.999509 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:11.999405 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 17:01:12.000559 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.000537 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 17:01:12.000643 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.000567 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pt94k\"" Jun 02 17:01:12.005706 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.005683 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7"] Jun 02 17:01:12.093207 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.093173 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7"] Jun 02 17:01:12.096008 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.095986 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.096144 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.096062 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w"] Jun 02 17:01:12.098483 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.098462 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 17:01:12.098483 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.098478 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 17:01:12.098716 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.098698 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc"] Jun 02 17:01:12.098801 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.098789 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w" Jun 02 17:01:12.098857 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.098831 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 17:01:12.098989 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.098962 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:12.099061 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.099011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thr45\" (UniqueName: \"kubernetes.io/projected/2232283b-5c2c-4821-a988-c86c46a5beee-kube-api-access-thr45\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:12.099177 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.099155 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-sglcn\"" Jun 02 17:01:12.099412 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.099396 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 17:01:12.101427 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.101409 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-5h7fn"] Jun 02 17:01:12.101575 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.101541 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.101890 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.101853 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qrn2d\"" Jun 02 17:01:12.102072 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.102053 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 17:01:12.102172 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.102097 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 17:01:12.104104 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.104089 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 17:01:12.104206 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.104130 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-c7hzb\"" Jun 02 17:01:12.104317 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.104301 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.104516 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.104437 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 17:01:12.105541 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.105522 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 17:01:12.105541 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.105535 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 17:01:12.105741 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.105726 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7"] Jun 02 17:01:12.106760 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.106740 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 17:01:12.106864 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.106783 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 17:01:12.106864 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.106856 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-59g6v\"" Jun 02 17:01:12.107032 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.107016 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 17:01:12.107091 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.107017 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 17:01:12.115291 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.115264 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w"] Jun 02 17:01:12.116381 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.116358 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc"] Jun 02 17:01:12.118107 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.118082 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-5h7fn"] Jun 02 17:01:12.118892 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.118854 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 17:01:12.199982 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.199954 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:12.200122 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.199988 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thr45\" (UniqueName: \"kubernetes.io/projected/2232283b-5c2c-4821-a988-c86c46a5beee-kube-api-access-thr45\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:12.200122 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9e6780a-6384-4cdc-8c10-9380f591dd22-config\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.200122 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200073 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvwcs\" (UniqueName: \"kubernetes.io/projected/540118e7-6648-4bd6-80d3-4fae5f384a6d-kube-api-access-gvwcs\") pod \"service-ca-operator-69877444c-jrhpc\" (UID: \"540118e7-6648-4bd6-80d3-4fae5f384a6d\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.200122 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:12.200097 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 17:01:12.200261 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200209 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9e6780a-6384-4cdc-8c10-9380f591dd22-trusted-ca\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.200261 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:12.200229 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls podName:2232283b-5c2c-4821-a988-c86c46a5beee nodeName:}" failed. No retries permitted until 2026-06-02 17:01:12.700212211 +0000 UTC m=+146.819174823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-r62n7" (UID: "2232283b-5c2c-4821-a988-c86c46a5beee") : secret "samples-operator-tls" not found Jun 02 17:01:12.200338 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200313 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/540118e7-6648-4bd6-80d3-4fae5f384a6d-config\") pod \"service-ca-operator-69877444c-jrhpc\" (UID: \"540118e7-6648-4bd6-80d3-4fae5f384a6d\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.200373 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200359 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e6780a-6384-4cdc-8c10-9380f591dd22-serving-cert\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.200413 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f53cb65-c3c4-423f-bfdd-0095e4877922-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-5mxm7\" (UID: \"7f53cb65-c3c4-423f-bfdd-0095e4877922\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.200413 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hklhm\" (UniqueName: \"kubernetes.io/projected/d9e6780a-6384-4cdc-8c10-9380f591dd22-kube-api-access-hklhm\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.200479 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvlc\" (UniqueName: \"kubernetes.io/projected/7f53cb65-c3c4-423f-bfdd-0095e4877922-kube-api-access-6bvlc\") pod \"kube-storage-version-migrator-operator-96ddc787c-5mxm7\" (UID: \"7f53cb65-c3c4-423f-bfdd-0095e4877922\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.200479 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/540118e7-6648-4bd6-80d3-4fae5f384a6d-serving-cert\") pod \"service-ca-operator-69877444c-jrhpc\" (UID: \"540118e7-6648-4bd6-80d3-4fae5f384a6d\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.200544 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200492 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb65-c3c4-423f-bfdd-0095e4877922-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-5mxm7\" (UID: \"7f53cb65-c3c4-423f-bfdd-0095e4877922\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.200544 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.200508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62rl8\" (UniqueName: \"kubernetes.io/projected/bd2fcb5e-830d-4ee0-a735-b324dade245b-kube-api-access-62rl8\") pod \"volume-data-source-validator-7598fd5bd-njz9w\" (UID: \"bd2fcb5e-830d-4ee0-a735-b324dade245b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w" Jun 02 17:01:12.208702 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.208682 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thr45\" (UniqueName: \"kubernetes.io/projected/2232283b-5c2c-4821-a988-c86c46a5beee-kube-api-access-thr45\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:12.301294 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301218 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9e6780a-6384-4cdc-8c10-9380f591dd22-trusted-ca\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.301294 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301255 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/540118e7-6648-4bd6-80d3-4fae5f384a6d-config\") pod \"service-ca-operator-69877444c-jrhpc\" (UID: \"540118e7-6648-4bd6-80d3-4fae5f384a6d\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.301294 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301288 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e6780a-6384-4cdc-8c10-9380f591dd22-serving-cert\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.301540 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301370 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f53cb65-c3c4-423f-bfdd-0095e4877922-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-5mxm7\" (UID: \"7f53cb65-c3c4-423f-bfdd-0095e4877922\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.301540 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301420 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hklhm\" (UniqueName: \"kubernetes.io/projected/d9e6780a-6384-4cdc-8c10-9380f591dd22-kube-api-access-hklhm\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.301540 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301460 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvlc\" (UniqueName: \"kubernetes.io/projected/7f53cb65-c3c4-423f-bfdd-0095e4877922-kube-api-access-6bvlc\") pod \"kube-storage-version-migrator-operator-96ddc787c-5mxm7\" (UID: \"7f53cb65-c3c4-423f-bfdd-0095e4877922\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.301540 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301482 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/540118e7-6648-4bd6-80d3-4fae5f384a6d-serving-cert\") pod \"service-ca-operator-69877444c-jrhpc\" (UID: \"540118e7-6648-4bd6-80d3-4fae5f384a6d\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.301540 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301534 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb65-c3c4-423f-bfdd-0095e4877922-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-5mxm7\" (UID: \"7f53cb65-c3c4-423f-bfdd-0095e4877922\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.301832 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301595 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62rl8\" (UniqueName: \"kubernetes.io/projected/bd2fcb5e-830d-4ee0-a735-b324dade245b-kube-api-access-62rl8\") pod \"volume-data-source-validator-7598fd5bd-njz9w\" (UID: \"bd2fcb5e-830d-4ee0-a735-b324dade245b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w" Jun 02 17:01:12.301832 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301658 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9e6780a-6384-4cdc-8c10-9380f591dd22-config\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.301832 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301704 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvwcs\" (UniqueName: \"kubernetes.io/projected/540118e7-6648-4bd6-80d3-4fae5f384a6d-kube-api-access-gvwcs\") pod \"service-ca-operator-69877444c-jrhpc\" (UID: \"540118e7-6648-4bd6-80d3-4fae5f384a6d\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.301981 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.301920 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/540118e7-6648-4bd6-80d3-4fae5f384a6d-config\") pod \"service-ca-operator-69877444c-jrhpc\" (UID: \"540118e7-6648-4bd6-80d3-4fae5f384a6d\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.302030 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.302001 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f53cb65-c3c4-423f-bfdd-0095e4877922-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-5mxm7\" (UID: \"7f53cb65-c3c4-423f-bfdd-0095e4877922\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.302203 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.302170 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9e6780a-6384-4cdc-8c10-9380f591dd22-trusted-ca\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.302435 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.302416 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9e6780a-6384-4cdc-8c10-9380f591dd22-config\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.303808 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.303787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9e6780a-6384-4cdc-8c10-9380f591dd22-serving-cert\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.304058 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.304040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/540118e7-6648-4bd6-80d3-4fae5f384a6d-serving-cert\") pod \"service-ca-operator-69877444c-jrhpc\" (UID: \"540118e7-6648-4bd6-80d3-4fae5f384a6d\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.304119 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.304075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f53cb65-c3c4-423f-bfdd-0095e4877922-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-5mxm7\" (UID: \"7f53cb65-c3c4-423f-bfdd-0095e4877922\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.309583 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.309429 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvwcs\" (UniqueName: \"kubernetes.io/projected/540118e7-6648-4bd6-80d3-4fae5f384a6d-kube-api-access-gvwcs\") pod \"service-ca-operator-69877444c-jrhpc\" (UID: \"540118e7-6648-4bd6-80d3-4fae5f384a6d\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.309846 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.309809 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvlc\" (UniqueName: \"kubernetes.io/projected/7f53cb65-c3c4-423f-bfdd-0095e4877922-kube-api-access-6bvlc\") pod \"kube-storage-version-migrator-operator-96ddc787c-5mxm7\" (UID: \"7f53cb65-c3c4-423f-bfdd-0095e4877922\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.309962 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.309942 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62rl8\" (UniqueName: \"kubernetes.io/projected/bd2fcb5e-830d-4ee0-a735-b324dade245b-kube-api-access-62rl8\") pod \"volume-data-source-validator-7598fd5bd-njz9w\" (UID: \"bd2fcb5e-830d-4ee0-a735-b324dade245b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w" Jun 02 17:01:12.310028 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.310008 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hklhm\" (UniqueName: \"kubernetes.io/projected/d9e6780a-6384-4cdc-8c10-9380f591dd22-kube-api-access-hklhm\") pod \"console-operator-86d7c6cc77-5h7fn\" (UID: \"d9e6780a-6384-4cdc-8c10-9380f591dd22\") " pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.407607 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.407586 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" Jun 02 17:01:12.416250 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.416231 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w" Jun 02 17:01:12.423821 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.423801 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" Jun 02 17:01:12.429396 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.429373 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:12.557584 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.557496 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7"] Jun 02 17:01:12.563345 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:12.563312 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53cb65_c3c4_423f_bfdd_0095e4877922.slice/crio-85df0101e8b48bbd10d9e68286dc75bb6d54d00624538eb22c1e10648e358dda WatchSource:0}: Error finding container 85df0101e8b48bbd10d9e68286dc75bb6d54d00624538eb22c1e10648e358dda: Status 404 returned error can't find the container with id 85df0101e8b48bbd10d9e68286dc75bb6d54d00624538eb22c1e10648e358dda Jun 02 17:01:12.576663 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.576630 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w"] Jun 02 17:01:12.580195 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:12.580171 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd2fcb5e_830d_4ee0_a735_b324dade245b.slice/crio-6db883bf7c3f59abbec1e136ba9ea67b8c1878240dd39583a3436d02fbc47450 WatchSource:0}: Error finding container 6db883bf7c3f59abbec1e136ba9ea67b8c1878240dd39583a3436d02fbc47450: Status 404 returned error can't find the container with id 6db883bf7c3f59abbec1e136ba9ea67b8c1878240dd39583a3436d02fbc47450 Jun 02 17:01:12.589824 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.589801 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc"] Jun 02 17:01:12.592211 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:12.592188 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540118e7_6648_4bd6_80d3_4fae5f384a6d.slice/crio-50d68fe125aa8e24a08d345d5a5ef11b2414baeb47e09ccf86765ec2f1cf141a WatchSource:0}: Error finding container 50d68fe125aa8e24a08d345d5a5ef11b2414baeb47e09ccf86765ec2f1cf141a: Status 404 returned error can't find the container with id 50d68fe125aa8e24a08d345d5a5ef11b2414baeb47e09ccf86765ec2f1cf141a Jun 02 17:01:12.607541 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.607518 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-5h7fn"] Jun 02 17:01:12.609976 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:12.609949 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e6780a_6384_4cdc_8c10_9380f591dd22.slice/crio-d2bd1b66001c71d56ff411610efd9d8de6d4dd28e4cdd8e794654479f5242087 WatchSource:0}: Error finding container d2bd1b66001c71d56ff411610efd9d8de6d4dd28e4cdd8e794654479f5242087: Status 404 returned error can't find the container with id d2bd1b66001c71d56ff411610efd9d8de6d4dd28e4cdd8e794654479f5242087 Jun 02 17:01:12.704656 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.704628 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:12.704799 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:12.704777 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 17:01:12.704868 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:12.704856 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls podName:2232283b-5c2c-4821-a988-c86c46a5beee nodeName:}" failed. No retries permitted until 2026-06-02 17:01:13.704833588 +0000 UTC m=+147.823796192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-r62n7" (UID: "2232283b-5c2c-4821-a988-c86c46a5beee") : secret "samples-operator-tls" not found Jun 02 17:01:12.799608 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.799574 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" event={"ID":"540118e7-6648-4bd6-80d3-4fae5f384a6d","Type":"ContainerStarted","Data":"50d68fe125aa8e24a08d345d5a5ef11b2414baeb47e09ccf86765ec2f1cf141a"} Jun 02 17:01:12.800464 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.800424 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w" event={"ID":"bd2fcb5e-830d-4ee0-a735-b324dade245b","Type":"ContainerStarted","Data":"6db883bf7c3f59abbec1e136ba9ea67b8c1878240dd39583a3436d02fbc47450"} Jun 02 17:01:12.801306 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.801276 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" event={"ID":"d9e6780a-6384-4cdc-8c10-9380f591dd22","Type":"ContainerStarted","Data":"d2bd1b66001c71d56ff411610efd9d8de6d4dd28e4cdd8e794654479f5242087"} Jun 02 17:01:12.802250 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:12.802230 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" event={"ID":"7f53cb65-c3c4-423f-bfdd-0095e4877922","Type":"ContainerStarted","Data":"85df0101e8b48bbd10d9e68286dc75bb6d54d00624538eb22c1e10648e358dda"} Jun 02 17:01:13.713407 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:13.713369 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:13.713898 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:13.713527 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 17:01:13.713898 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:13.713619 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls podName:2232283b-5c2c-4821-a988-c86c46a5beee nodeName:}" failed. No retries permitted until 2026-06-02 17:01:15.713598791 +0000 UTC m=+149.832561398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-r62n7" (UID: "2232283b-5c2c-4821-a988-c86c46a5beee") : secret "samples-operator-tls" not found Jun 02 17:01:15.729105 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:15.729068 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:15.729516 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:15.729197 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 17:01:15.729516 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:15.729262 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls podName:2232283b-5c2c-4821-a988-c86c46a5beee nodeName:}" failed. No retries permitted until 2026-06-02 17:01:19.729247074 +0000 UTC m=+153.848209669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-r62n7" (UID: "2232283b-5c2c-4821-a988-c86c46a5beee") : secret "samples-operator-tls" not found Jun 02 17:01:16.812708 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:16.812674 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" event={"ID":"7f53cb65-c3c4-423f-bfdd-0095e4877922","Type":"ContainerStarted","Data":"698119c5856f7db4b00ecd394aa7b69c4198b4676618161d3fa1bc040660847a"} Jun 02 17:01:16.814053 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:16.814022 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" event={"ID":"540118e7-6648-4bd6-80d3-4fae5f384a6d","Type":"ContainerStarted","Data":"d92ec0f6e7c2199653016d484e14d5b25837d3c9d7995ec2234884160aa50264"} Jun 02 17:01:16.815453 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:16.815420 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w" event={"ID":"bd2fcb5e-830d-4ee0-a735-b324dade245b","Type":"ContainerStarted","Data":"888066a1c6948987c2b5e8f3b4c3c39fa472885fd9ced19c3af2d16988e8ddd8"} Jun 02 17:01:16.816959 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:16.816937 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/0.log" Jun 02 17:01:16.817055 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:16.816976 2561 generic.go:358] "Generic (PLEG): container finished" podID="d9e6780a-6384-4cdc-8c10-9380f591dd22" containerID="22c65548f3a7016d6889037033af4cde4b6fe187a115a98209daeb9caf7327ea" exitCode=255 Jun 02 17:01:16.817055 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:16.817044 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" event={"ID":"d9e6780a-6384-4cdc-8c10-9380f591dd22","Type":"ContainerDied","Data":"22c65548f3a7016d6889037033af4cde4b6fe187a115a98209daeb9caf7327ea"} Jun 02 17:01:16.817194 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:16.817180 2561 scope.go:117] "RemoveContainer" containerID="22c65548f3a7016d6889037033af4cde4b6fe187a115a98209daeb9caf7327ea" Jun 02 17:01:16.827889 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:16.827834 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" podStartSLOduration=1.586754029 podStartE2EDuration="4.82781791s" podCreationTimestamp="2026-06-02 17:01:12 +0000 UTC" firstStartedPulling="2026-06-02 17:01:12.566218763 +0000 UTC m=+146.685181361" lastFinishedPulling="2026-06-02 17:01:15.807282642 +0000 UTC m=+149.926245242" observedRunningTime="2026-06-02 17:01:16.827083058 +0000 UTC m=+150.946045678" watchObservedRunningTime="2026-06-02 17:01:16.82781791 +0000 UTC m=+150.946780527" Jun 02 17:01:16.842048 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:16.841994 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-njz9w" podStartSLOduration=1.621385767 podStartE2EDuration="4.841976851s" podCreationTimestamp="2026-06-02 17:01:12 +0000 UTC" firstStartedPulling="2026-06-02 17:01:12.582037235 +0000 UTC m=+146.700999827" lastFinishedPulling="2026-06-02 17:01:15.802628318 +0000 UTC m=+149.921590911" observedRunningTime="2026-06-02 17:01:16.841260766 +0000 UTC m=+150.960223384" watchObservedRunningTime="2026-06-02 17:01:16.841976851 +0000 UTC m=+150.960939468" Jun 02 17:01:16.858900 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:16.858854 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" podStartSLOduration=1.649601311 podStartE2EDuration="4.858838967s" podCreationTimestamp="2026-06-02 17:01:12 +0000 UTC" firstStartedPulling="2026-06-02 17:01:12.593858672 +0000 UTC m=+146.712821265" lastFinishedPulling="2026-06-02 17:01:15.803096326 +0000 UTC m=+149.922058921" observedRunningTime="2026-06-02 17:01:16.858341843 +0000 UTC m=+150.977304460" watchObservedRunningTime="2026-06-02 17:01:16.858838967 +0000 UTC m=+150.977801582" Jun 02 17:01:17.821298 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:17.821273 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/1.log" Jun 02 17:01:17.821707 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:17.821632 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/0.log" Jun 02 17:01:17.821707 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:17.821665 2561 generic.go:358] "Generic (PLEG): container finished" podID="d9e6780a-6384-4cdc-8c10-9380f591dd22" containerID="8ef9d1edc88a5bebef15cbc22bd0845e0fe9cd9b8f4d5c4e1703c37b681aa73f" exitCode=255 Jun 02 17:01:17.821810 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:17.821780 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" event={"ID":"d9e6780a-6384-4cdc-8c10-9380f591dd22","Type":"ContainerDied","Data":"8ef9d1edc88a5bebef15cbc22bd0845e0fe9cd9b8f4d5c4e1703c37b681aa73f"} Jun 02 17:01:17.821894 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:17.821831 2561 scope.go:117] "RemoveContainer" containerID="22c65548f3a7016d6889037033af4cde4b6fe187a115a98209daeb9caf7327ea" Jun 02 17:01:17.822225 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:17.822208 2561 scope.go:117] "RemoveContainer" containerID="8ef9d1edc88a5bebef15cbc22bd0845e0fe9cd9b8f4d5c4e1703c37b681aa73f" Jun 02 17:01:17.822381 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:17.822364 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5h7fn_openshift-console-operator(d9e6780a-6384-4cdc-8c10-9380f591dd22)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" podUID="d9e6780a-6384-4cdc-8c10-9380f591dd22" Jun 02 17:01:17.848822 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:17.848798 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:17.848938 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:17.848921 2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:17.848989 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:17.848980 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls podName:9e02be24-e73f-4062-9f3d-d12e25f01d30 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:33.848965185 +0000 UTC m=+167.967927778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-4cxmg" (UID: "9e02be24-e73f-4062-9f3d-d12e25f01d30") : secret "cluster-monitoring-operator-tls" not found Jun 02 17:01:18.825251 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:18.825227 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/1.log" Jun 02 17:01:18.825632 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:18.825528 2561 scope.go:117] "RemoveContainer" containerID="8ef9d1edc88a5bebef15cbc22bd0845e0fe9cd9b8f4d5c4e1703c37b681aa73f" Jun 02 17:01:18.825730 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:18.825712 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5h7fn_openshift-console-operator(d9e6780a-6384-4cdc-8c10-9380f591dd22)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" podUID="d9e6780a-6384-4cdc-8c10-9380f591dd22" Jun 02 17:01:19.146310 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.146233 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qpsns"] Jun 02 17:01:19.150121 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.150105 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.152720 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.152700 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 17:01:19.152831 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.152729 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ml6kr\"" Jun 02 17:01:19.152831 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.152821 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 17:01:19.158188 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.158164 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qpsns"] Jun 02 17:01:19.260122 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.260091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.260299 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.260141 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-data-volume\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.260299 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.260234 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-crio-socket\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.260413 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.260300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klzp4\" (UniqueName: \"kubernetes.io/projected/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-kube-api-access-klzp4\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.260413 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.260341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.361496 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.361464 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.361664 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.361507 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.361664 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.361627 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-data-volume\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.361664 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:19.361643 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 02 17:01:19.361835 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:19.361709 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls podName:ef16754b-e9b2-4bd8-95e4-6a33a588af9e nodeName:}" failed. No retries permitted until 2026-06-02 17:01:19.861688643 +0000 UTC m=+153.980651237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpsns" (UID: "ef16754b-e9b2-4bd8-95e4-6a33a588af9e") : secret "insights-runtime-extractor-tls" not found Jun 02 17:01:19.361835 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.361754 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-crio-socket\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.361835 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.361820 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klzp4\" (UniqueName: \"kubernetes.io/projected/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-kube-api-access-klzp4\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.361977 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.361891 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-crio-socket\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.361977 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.361948 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-data-volume\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.362118 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.362101 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.373091 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.373067 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klzp4\" (UniqueName: \"kubernetes.io/projected/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-kube-api-access-klzp4\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.765468 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.765433 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:19.765690 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:19.765610 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 17:01:19.765747 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:19.765697 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls podName:2232283b-5c2c-4821-a988-c86c46a5beee nodeName:}" failed. No retries permitted until 2026-06-02 17:01:27.76568133 +0000 UTC m=+161.884643923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-r62n7" (UID: "2232283b-5c2c-4821-a988-c86c46a5beee") : secret "samples-operator-tls" not found Jun 02 17:01:19.866851 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.866823 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:19.867214 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:19.866963 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 02 17:01:19.867214 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:19.867020 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls podName:ef16754b-e9b2-4bd8-95e4-6a33a588af9e nodeName:}" failed. No retries permitted until 2026-06-02 17:01:20.867005994 +0000 UTC m=+154.985968587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpsns" (UID: "ef16754b-e9b2-4bd8-95e4-6a33a588af9e") : secret "insights-runtime-extractor-tls" not found Jun 02 17:01:19.962539 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.962505 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-thvnn"] Jun 02 17:01:19.966842 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.966828 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:19.969780 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.969759 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 17:01:19.969920 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.969818 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 17:01:19.969920 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.969843 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 17:01:19.970010 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.969920 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 17:01:19.970044 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.970023 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-llx4n\"" Jun 02 17:01:19.972380 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:19.972359 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-thvnn"] Jun 02 17:01:20.068603 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.068515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19811977-edb4-49ae-8368-ece8582a8cc8-signing-cabundle\") pod \"service-ca-685df94d57-thvnn\" (UID: \"19811977-edb4-49ae-8368-ece8582a8cc8\") " pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:20.068749 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.068680 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19811977-edb4-49ae-8368-ece8582a8cc8-signing-key\") pod \"service-ca-685df94d57-thvnn\" (UID: \"19811977-edb4-49ae-8368-ece8582a8cc8\") " pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:20.068749 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.068734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r92n\" (UniqueName: \"kubernetes.io/projected/19811977-edb4-49ae-8368-ece8582a8cc8-kube-api-access-9r92n\") pod \"service-ca-685df94d57-thvnn\" (UID: \"19811977-edb4-49ae-8368-ece8582a8cc8\") " pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:20.170009 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.169974 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19811977-edb4-49ae-8368-ece8582a8cc8-signing-cabundle\") pod \"service-ca-685df94d57-thvnn\" (UID: \"19811977-edb4-49ae-8368-ece8582a8cc8\") " pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:20.170169 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.170092 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19811977-edb4-49ae-8368-ece8582a8cc8-signing-key\") pod \"service-ca-685df94d57-thvnn\" (UID: \"19811977-edb4-49ae-8368-ece8582a8cc8\") " pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:20.170169 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.170118 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9r92n\" (UniqueName: \"kubernetes.io/projected/19811977-edb4-49ae-8368-ece8582a8cc8-kube-api-access-9r92n\") pod \"service-ca-685df94d57-thvnn\" (UID: \"19811977-edb4-49ae-8368-ece8582a8cc8\") " pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:20.170659 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.170639 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19811977-edb4-49ae-8368-ece8582a8cc8-signing-cabundle\") pod \"service-ca-685df94d57-thvnn\" (UID: \"19811977-edb4-49ae-8368-ece8582a8cc8\") " pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:20.172503 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.172482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19811977-edb4-49ae-8368-ece8582a8cc8-signing-key\") pod \"service-ca-685df94d57-thvnn\" (UID: \"19811977-edb4-49ae-8368-ece8582a8cc8\") " pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:20.178980 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.178958 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r92n\" (UniqueName: \"kubernetes.io/projected/19811977-edb4-49ae-8368-ece8582a8cc8-kube-api-access-9r92n\") pod \"service-ca-685df94d57-thvnn\" (UID: \"19811977-edb4-49ae-8368-ece8582a8cc8\") " pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:20.279706 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.279679 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-thvnn" Jun 02 17:01:20.398029 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.398004 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-thvnn"] Jun 02 17:01:20.400255 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:20.400226 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19811977_edb4_49ae_8368_ece8582a8cc8.slice/crio-22f6ab8d8689df43ca5301ae96df706482c6118efb02cb3dcde468e37021a80e WatchSource:0}: Error finding container 22f6ab8d8689df43ca5301ae96df706482c6118efb02cb3dcde468e37021a80e: Status 404 returned error can't find the container with id 22f6ab8d8689df43ca5301ae96df706482c6118efb02cb3dcde468e37021a80e Jun 02 17:01:20.833866 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.833829 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-thvnn" event={"ID":"19811977-edb4-49ae-8368-ece8582a8cc8","Type":"ContainerStarted","Data":"c1b576cf05aeaeb686dbba629eeb71eb71ae1106ae3eed65882f8bc10f75680a"} Jun 02 17:01:20.833866 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.833871 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-thvnn" event={"ID":"19811977-edb4-49ae-8368-ece8582a8cc8","Type":"ContainerStarted","Data":"22f6ab8d8689df43ca5301ae96df706482c6118efb02cb3dcde468e37021a80e"} Jun 02 17:01:20.861901 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.861862 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-thvnn" podStartSLOduration=1.8618505509999999 podStartE2EDuration="1.861850551s" podCreationTimestamp="2026-06-02 17:01:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:01:20.861226338 +0000 UTC m=+154.980188952" watchObservedRunningTime="2026-06-02 17:01:20.861850551 +0000 UTC m=+154.980813165" Jun 02 17:01:20.875398 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:20.875375 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:20.875745 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:20.875534 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 02 17:01:20.875745 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:20.875622 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls podName:ef16754b-e9b2-4bd8-95e4-6a33a588af9e nodeName:}" failed. No retries permitted until 2026-06-02 17:01:22.87560487 +0000 UTC m=+156.994567478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpsns" (UID: "ef16754b-e9b2-4bd8-95e4-6a33a588af9e") : secret "insights-runtime-extractor-tls" not found Jun 02 17:01:22.430155 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:22.430128 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:22.430155 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:22.430155 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:22.430581 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:22.430457 2561 scope.go:117] "RemoveContainer" containerID="8ef9d1edc88a5bebef15cbc22bd0845e0fe9cd9b8f4d5c4e1703c37b681aa73f" Jun 02 17:01:22.430645 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:22.430625 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5h7fn_openshift-console-operator(d9e6780a-6384-4cdc-8c10-9380f591dd22)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" podUID="d9e6780a-6384-4cdc-8c10-9380f591dd22" Jun 02 17:01:22.892597 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:22.892567 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:22.892794 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:22.892700 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 02 17:01:22.892794 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:22.892768 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls podName:ef16754b-e9b2-4bd8-95e4-6a33a588af9e nodeName:}" failed. No retries permitted until 2026-06-02 17:01:26.892751986 +0000 UTC m=+161.011714595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpsns" (UID: "ef16754b-e9b2-4bd8-95e4-6a33a588af9e") : secret "insights-runtime-extractor-tls" not found Jun 02 17:01:23.777541 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:23.777501 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w4rwh" podUID="08960404-6b30-4974-a440-37b70c47fbe9" Jun 02 17:01:23.777964 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:23.777738 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-jjcp4" podUID="c30e571f-e427-448b-a305-f0a1c032bbcc" Jun 02 17:01:23.841107 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:23.841077 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 17:01:23.841249 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:23.841080 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w4rwh" Jun 02 17:01:25.410375 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:25.410332 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dfg6z" podUID="e7d51764-e935-4acf-a016-44f761ffb245" Jun 02 17:01:26.924537 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:26.924455 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:26.924995 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:26.924581 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 02 17:01:26.924995 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:26.924644 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls podName:ef16754b-e9b2-4bd8-95e4-6a33a588af9e nodeName:}" failed. No retries permitted until 2026-06-02 17:01:34.924629218 +0000 UTC m=+169.043591811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qpsns" (UID: "ef16754b-e9b2-4bd8-95e4-6a33a588af9e") : secret "insights-runtime-extractor-tls" not found Jun 02 17:01:27.832912 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:27.832854 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:27.835164 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:27.835144 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2232283b-5c2c-4821-a988-c86c46a5beee-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-r62n7\" (UID: \"2232283b-5c2c-4821-a988-c86c46a5beee\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:27.904806 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:27.904781 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" Jun 02 17:01:28.022822 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:28.022779 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7"] Jun 02 17:01:28.640481 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:28.640447 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 17:01:28.640673 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:28.640511 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 17:01:28.642900 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:28.642874 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/08960404-6b30-4974-a440-37b70c47fbe9-metrics-tls\") pod \"dns-default-w4rwh\" (UID: \"08960404-6b30-4974-a440-37b70c47fbe9\") " pod="openshift-dns/dns-default-w4rwh" Jun 02 17:01:28.643163 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:28.643140 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c30e571f-e427-448b-a305-f0a1c032bbcc-cert\") pod \"ingress-canary-jjcp4\" (UID: \"c30e571f-e427-448b-a305-f0a1c032bbcc\") " pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 17:01:28.854410 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:28.854370 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" event={"ID":"2232283b-5c2c-4821-a988-c86c46a5beee","Type":"ContainerStarted","Data":"c39417bed7ac90e1bb25ba06e1a0082882d6b39654f2a22448ec2d4d3baab366"} Jun 02 17:01:28.944601 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:28.944504 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nfxvm\"" Jun 02 17:01:28.945739 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:28.945711 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x4vx8\"" Jun 02 17:01:28.951863 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:28.951839 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w4rwh" Jun 02 17:01:28.951987 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:28.951936 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jjcp4" Jun 02 17:01:29.107065 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:29.107034 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jjcp4"] Jun 02 17:01:29.112416 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:29.112386 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30e571f_e427_448b_a305_f0a1c032bbcc.slice/crio-41d29fde6d2f4595f0f008d7b1ebea6e1bf341fc2df2cb6a9a7dd9578465d4a6 WatchSource:0}: Error finding container 41d29fde6d2f4595f0f008d7b1ebea6e1bf341fc2df2cb6a9a7dd9578465d4a6: Status 404 returned error can't find the container with id 41d29fde6d2f4595f0f008d7b1ebea6e1bf341fc2df2cb6a9a7dd9578465d4a6 Jun 02 17:01:29.125286 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:29.125260 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w4rwh"] Jun 02 17:01:29.129039 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:29.129006 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08960404_6b30_4974_a440_37b70c47fbe9.slice/crio-cc34da6838b50f713c258d501b18bbc1a363b4f510618b01dd73413e01847625 WatchSource:0}: Error finding container cc34da6838b50f713c258d501b18bbc1a363b4f510618b01dd73413e01847625: Status 404 returned error can't find the container with id cc34da6838b50f713c258d501b18bbc1a363b4f510618b01dd73413e01847625 Jun 02 17:01:29.863496 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:29.863450 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" event={"ID":"2232283b-5c2c-4821-a988-c86c46a5beee","Type":"ContainerStarted","Data":"783acc00ba75ff41079536590878e510044dbe44f5a4666de1ca6d7a58bd42b6"} Jun 02 17:01:29.864733 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:29.864697 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w4rwh" event={"ID":"08960404-6b30-4974-a440-37b70c47fbe9","Type":"ContainerStarted","Data":"cc34da6838b50f713c258d501b18bbc1a363b4f510618b01dd73413e01847625"} Jun 02 17:01:29.865859 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:29.865839 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jjcp4" event={"ID":"c30e571f-e427-448b-a305-f0a1c032bbcc","Type":"ContainerStarted","Data":"41d29fde6d2f4595f0f008d7b1ebea6e1bf341fc2df2cb6a9a7dd9578465d4a6"} Jun 02 17:01:30.871292 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:30.871254 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" event={"ID":"2232283b-5c2c-4821-a988-c86c46a5beee","Type":"ContainerStarted","Data":"cea357196ae7286cacaa54b972fadafa3e58304821d1848f56e072caccfe05de"} Jun 02 17:01:30.887906 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:30.887859 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-r62n7" podStartSLOduration=18.196765863 podStartE2EDuration="19.887841106s" podCreationTimestamp="2026-06-02 17:01:11 +0000 UTC" firstStartedPulling="2026-06-02 17:01:28.064009273 +0000 UTC m=+162.182971866" lastFinishedPulling="2026-06-02 17:01:29.755084503 +0000 UTC m=+163.874047109" observedRunningTime="2026-06-02 17:01:30.887636678 +0000 UTC m=+165.006599293" watchObservedRunningTime="2026-06-02 17:01:30.887841106 +0000 UTC m=+165.006803721" Jun 02 17:01:31.875781 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:31.875690 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w4rwh" event={"ID":"08960404-6b30-4974-a440-37b70c47fbe9","Type":"ContainerStarted","Data":"277fad5571f39b749732ffce01abb6607986fe7054b204ce90af4cbb465fbc81"} Jun 02 17:01:31.875781 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:31.875734 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w4rwh" event={"ID":"08960404-6b30-4974-a440-37b70c47fbe9","Type":"ContainerStarted","Data":"97436e6e3494dcd75db92eaf1b5fa9551aabe0332ea8f1db054dd7bee5f26e33"} Jun 02 17:01:31.876246 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:31.875963 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w4rwh" Jun 02 17:01:31.876930 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:31.876910 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jjcp4" event={"ID":"c30e571f-e427-448b-a305-f0a1c032bbcc","Type":"ContainerStarted","Data":"52cb4a2ab9dcb6c20ed331b77f626c986a6c739c4f9cb2a64b92955e7a7a2412"} Jun 02 17:01:31.894236 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:31.893546 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-w4rwh" podStartSLOduration=130.012153065 podStartE2EDuration="2m11.893531317s" podCreationTimestamp="2026-06-02 16:59:20 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.131508396 +0000 UTC m=+163.250470988" lastFinishedPulling="2026-06-02 17:01:31.012886644 +0000 UTC m=+165.131849240" observedRunningTime="2026-06-02 17:01:31.892242534 +0000 UTC m=+166.011205148" watchObservedRunningTime="2026-06-02 17:01:31.893531317 +0000 UTC m=+166.012493933" Jun 02 17:01:33.882544 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:33.882510 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:33.885070 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:33.885050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9e02be24-e73f-4062-9f3d-d12e25f01d30-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-4cxmg\" (UID: \"9e02be24-e73f-4062-9f3d-d12e25f01d30\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:34.123940 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.123905 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" Jun 02 17:01:34.239259 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.239205 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jjcp4" podStartSLOduration=131.717739066 podStartE2EDuration="2m14.239189626s" podCreationTimestamp="2026-06-02 16:59:20 +0000 UTC" firstStartedPulling="2026-06-02 17:01:29.114171762 +0000 UTC m=+163.233134356" lastFinishedPulling="2026-06-02 17:01:31.635622321 +0000 UTC m=+165.754584916" observedRunningTime="2026-06-02 17:01:31.909020913 +0000 UTC m=+166.027983530" watchObservedRunningTime="2026-06-02 17:01:34.239189626 +0000 UTC m=+168.358152242" Jun 02 17:01:34.240148 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.240127 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg"] Jun 02 17:01:34.242824 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:34.242793 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e02be24_e73f_4062_9f3d_d12e25f01d30.slice/crio-1c95fa11cc90c8c34d25f86e44b571535dc9bf4f4a88793e998e076dfdcf9214 WatchSource:0}: Error finding container 1c95fa11cc90c8c34d25f86e44b571535dc9bf4f4a88793e998e076dfdcf9214: Status 404 returned error can't find the container with id 1c95fa11cc90c8c34d25f86e44b571535dc9bf4f4a88793e998e076dfdcf9214 Jun 02 17:01:34.403306 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.403281 2561 scope.go:117] "RemoveContainer" containerID="8ef9d1edc88a5bebef15cbc22bd0845e0fe9cd9b8f4d5c4e1703c37b681aa73f" Jun 02 17:01:34.887890 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.887854 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" event={"ID":"9e02be24-e73f-4062-9f3d-d12e25f01d30","Type":"ContainerStarted","Data":"1c95fa11cc90c8c34d25f86e44b571535dc9bf4f4a88793e998e076dfdcf9214"} Jun 02 17:01:34.889301 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.889282 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/2.log" Jun 02 17:01:34.889695 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.889680 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/1.log" Jun 02 17:01:34.889755 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.889711 2561 generic.go:358] "Generic (PLEG): container finished" podID="d9e6780a-6384-4cdc-8c10-9380f591dd22" containerID="75ea91672056777a7f38cf052916237c0906b534b2ade9029eb23045a49b0f39" exitCode=255 Jun 02 17:01:34.889755 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.889747 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" event={"ID":"d9e6780a-6384-4cdc-8c10-9380f591dd22","Type":"ContainerDied","Data":"75ea91672056777a7f38cf052916237c0906b534b2ade9029eb23045a49b0f39"} Jun 02 17:01:34.889826 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.889775 2561 scope.go:117] "RemoveContainer" containerID="8ef9d1edc88a5bebef15cbc22bd0845e0fe9cd9b8f4d5c4e1703c37b681aa73f" Jun 02 17:01:34.890127 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.890107 2561 scope.go:117] "RemoveContainer" containerID="75ea91672056777a7f38cf052916237c0906b534b2ade9029eb23045a49b0f39" Jun 02 17:01:34.890327 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:34.890305 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5h7fn_openshift-console-operator(d9e6780a-6384-4cdc-8c10-9380f591dd22)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" podUID="d9e6780a-6384-4cdc-8c10-9380f591dd22" Jun 02 17:01:34.991181 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.991145 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:34.993482 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:34.993461 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef16754b-e9b2-4bd8-95e4-6a33a588af9e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qpsns\" (UID: \"ef16754b-e9b2-4bd8-95e4-6a33a588af9e\") " pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:35.059569 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:35.059529 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qpsns" Jun 02 17:01:35.191162 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:35.191133 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qpsns"] Jun 02 17:01:35.194216 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:35.194193 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef16754b_e9b2_4bd8_95e4_6a33a588af9e.slice/crio-81a88092d3bf04dfcd9e677c2f8817491a700cff50f87e35e84e7dcad1d10b90 WatchSource:0}: Error finding container 81a88092d3bf04dfcd9e677c2f8817491a700cff50f87e35e84e7dcad1d10b90: Status 404 returned error can't find the container with id 81a88092d3bf04dfcd9e677c2f8817491a700cff50f87e35e84e7dcad1d10b90 Jun 02 17:01:35.895567 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:35.895529 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/2.log" Jun 02 17:01:35.896923 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:35.896895 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpsns" event={"ID":"ef16754b-e9b2-4bd8-95e4-6a33a588af9e","Type":"ContainerStarted","Data":"2506e7d22e238a7104d7d588387b42c88824508200cb40a11a0a68ef3a5aaa35"} Jun 02 17:01:35.896923 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:35.896926 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpsns" event={"ID":"ef16754b-e9b2-4bd8-95e4-6a33a588af9e","Type":"ContainerStarted","Data":"81a88092d3bf04dfcd9e677c2f8817491a700cff50f87e35e84e7dcad1d10b90"} Jun 02 17:01:36.403545 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:36.403524 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 17:01:36.901369 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:36.901334 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" event={"ID":"9e02be24-e73f-4062-9f3d-d12e25f01d30","Type":"ContainerStarted","Data":"4f4071494981e3184b6ac5f12b83b49cd189d12298ec4bb0fb68b5d54ab0a29a"} Jun 02 17:01:36.902960 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:36.902924 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpsns" event={"ID":"ef16754b-e9b2-4bd8-95e4-6a33a588af9e","Type":"ContainerStarted","Data":"ee4c122028bf05b98364e4a4c4a0b9c90e5d037e877276e4b2ab81db04bc06ad"} Jun 02 17:01:36.918192 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:36.918142 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-4cxmg" podStartSLOduration=33.803910762 podStartE2EDuration="35.918124833s" podCreationTimestamp="2026-06-02 17:01:01 +0000 UTC" firstStartedPulling="2026-06-02 17:01:34.244602042 +0000 UTC m=+168.363564635" lastFinishedPulling="2026-06-02 17:01:36.35881611 +0000 UTC m=+170.477778706" observedRunningTime="2026-06-02 17:01:36.915724238 +0000 UTC m=+171.034686852" watchObservedRunningTime="2026-06-02 17:01:36.918124833 +0000 UTC m=+171.037087452" Jun 02 17:01:38.909091 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:38.909055 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qpsns" event={"ID":"ef16754b-e9b2-4bd8-95e4-6a33a588af9e","Type":"ContainerStarted","Data":"f1950fb2a04c0f9b1753f7689934d8d8b2c1c5183a5360723e5d35ba2ff638a5"} Jun 02 17:01:38.929656 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:38.929611 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qpsns" podStartSLOduration=17.062213393 podStartE2EDuration="19.929599355s" podCreationTimestamp="2026-06-02 17:01:19 +0000 UTC" firstStartedPulling="2026-06-02 17:01:35.252953463 +0000 UTC m=+169.371916056" lastFinishedPulling="2026-06-02 17:01:38.120339425 +0000 UTC m=+172.239302018" observedRunningTime="2026-06-02 17:01:38.927397828 +0000 UTC m=+173.046360493" watchObservedRunningTime="2026-06-02 17:01:38.929599355 +0000 UTC m=+173.048562012" Jun 02 17:01:39.421038 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.421002 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-796676d6bb-p6b6h"] Jun 02 17:01:39.424246 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.424223 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.427090 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.427058 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 17:01:39.427209 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.427145 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 17:01:39.427272 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.427242 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 17:01:39.428368 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.428351 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-z44jx\"" Jun 02 17:01:39.432883 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.432859 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 17:01:39.445808 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.445787 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-796676d6bb-p6b6h"] Jun 02 17:01:39.526919 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.526887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5341b370-8e16-4ed3-8de0-9c9f32dcea38-trusted-ca\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.527063 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.526926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx6br\" (UniqueName: \"kubernetes.io/projected/5341b370-8e16-4ed3-8de0-9c9f32dcea38-kube-api-access-fx6br\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.527063 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.526956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5341b370-8e16-4ed3-8de0-9c9f32dcea38-registry-certificates\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.527063 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.526983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5341b370-8e16-4ed3-8de0-9c9f32dcea38-bound-sa-token\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.527063 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.527030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5341b370-8e16-4ed3-8de0-9c9f32dcea38-registry-tls\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.527195 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.527067 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5341b370-8e16-4ed3-8de0-9c9f32dcea38-installation-pull-secrets\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.527195 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.527118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5341b370-8e16-4ed3-8de0-9c9f32dcea38-image-registry-private-configuration\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.527195 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.527135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5341b370-8e16-4ed3-8de0-9c9f32dcea38-ca-trust-extracted\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.627827 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.627793 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5341b370-8e16-4ed3-8de0-9c9f32dcea38-trusted-ca\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.627827 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.627827 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fx6br\" (UniqueName: \"kubernetes.io/projected/5341b370-8e16-4ed3-8de0-9c9f32dcea38-kube-api-access-fx6br\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.628065 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.627852 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5341b370-8e16-4ed3-8de0-9c9f32dcea38-registry-certificates\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.628065 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.627878 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5341b370-8e16-4ed3-8de0-9c9f32dcea38-bound-sa-token\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.628065 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.627914 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5341b370-8e16-4ed3-8de0-9c9f32dcea38-registry-tls\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.628065 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.627952 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5341b370-8e16-4ed3-8de0-9c9f32dcea38-installation-pull-secrets\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.628065 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.627998 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5341b370-8e16-4ed3-8de0-9c9f32dcea38-image-registry-private-configuration\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.628065 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.628025 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5341b370-8e16-4ed3-8de0-9c9f32dcea38-ca-trust-extracted\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.628603 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.628576 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5341b370-8e16-4ed3-8de0-9c9f32dcea38-ca-trust-extracted\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.628827 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.628805 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5341b370-8e16-4ed3-8de0-9c9f32dcea38-registry-certificates\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.628992 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.628968 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5341b370-8e16-4ed3-8de0-9c9f32dcea38-trusted-ca\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.630456 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.630428 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5341b370-8e16-4ed3-8de0-9c9f32dcea38-registry-tls\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.630456 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.630445 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5341b370-8e16-4ed3-8de0-9c9f32dcea38-image-registry-private-configuration\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.630590 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.630526 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5341b370-8e16-4ed3-8de0-9c9f32dcea38-installation-pull-secrets\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.635135 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.635110 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5341b370-8e16-4ed3-8de0-9c9f32dcea38-bound-sa-token\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.635219 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.635169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx6br\" (UniqueName: \"kubernetes.io/projected/5341b370-8e16-4ed3-8de0-9c9f32dcea38-kube-api-access-fx6br\") pod \"image-registry-796676d6bb-p6b6h\" (UID: \"5341b370-8e16-4ed3-8de0-9c9f32dcea38\") " pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.734507 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.734468 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:39.860978 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.860944 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-796676d6bb-p6b6h"] Jun 02 17:01:39.863924 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:39.863897 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5341b370_8e16_4ed3_8de0_9c9f32dcea38.slice/crio-50165bba592131f37ee9429a5a3e9a31410e949f80bbabb0422b39cc27950a5a WatchSource:0}: Error finding container 50165bba592131f37ee9429a5a3e9a31410e949f80bbabb0422b39cc27950a5a: Status 404 returned error can't find the container with id 50165bba592131f37ee9429a5a3e9a31410e949f80bbabb0422b39cc27950a5a Jun 02 17:01:39.913019 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:39.912995 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" event={"ID":"5341b370-8e16-4ed3-8de0-9c9f32dcea38","Type":"ContainerStarted","Data":"50165bba592131f37ee9429a5a3e9a31410e949f80bbabb0422b39cc27950a5a"} Jun 02 17:01:40.916297 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:40.916261 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" event={"ID":"5341b370-8e16-4ed3-8de0-9c9f32dcea38","Type":"ContainerStarted","Data":"328f793d442e0800e9093b24516fc57542e84d097a721c05b6b86135676cd98a"} Jun 02 17:01:40.916665 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:40.916373 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:01:40.934996 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:40.934957 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" podStartSLOduration=1.934943673 podStartE2EDuration="1.934943673s" podCreationTimestamp="2026-06-02 17:01:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:01:40.934617375 +0000 UTC m=+175.053579987" watchObservedRunningTime="2026-06-02 17:01:40.934943673 +0000 UTC m=+175.053906299" Jun 02 17:01:41.882629 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:41.882595 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w4rwh" Jun 02 17:01:42.429645 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:42.429614 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:42.429645 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:42.429649 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:01:42.430002 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:42.429919 2561 scope.go:117] "RemoveContainer" containerID="75ea91672056777a7f38cf052916237c0906b534b2ade9029eb23045a49b0f39" Jun 02 17:01:42.430077 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:42.430060 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5h7fn_openshift-console-operator(d9e6780a-6384-4cdc-8c10-9380f591dd22)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" podUID="d9e6780a-6384-4cdc-8c10-9380f591dd22" Jun 02 17:01:46.251805 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.251773 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-psd7n"] Jun 02 17:01:46.281993 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.281970 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.284850 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.284784 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 17:01:46.285500 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.285278 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g6tqw\"" Jun 02 17:01:46.285500 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.285468 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 17:01:46.286104 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.285937 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 17:01:46.286104 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.285967 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 17:01:46.376487 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.376461 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.376633 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.376500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-tls\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.376633 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.376522 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643340d1-8d20-43bf-833b-fb7260b6c4c7-sys\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.376633 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.376562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/643340d1-8d20-43bf-833b-fb7260b6c4c7-metrics-client-ca\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.376633 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.376629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-wtmp\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.376840 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.376667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/643340d1-8d20-43bf-833b-fb7260b6c4c7-root\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.376840 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.376689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h626l\" (UniqueName: \"kubernetes.io/projected/643340d1-8d20-43bf-833b-fb7260b6c4c7-kube-api-access-h626l\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.376840 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.376730 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-textfile\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.376840 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.376760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.477488 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.477442 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.477859 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.477503 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-tls\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.477859 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.477537 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643340d1-8d20-43bf-833b-fb7260b6c4c7-sys\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.477859 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.477576 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/643340d1-8d20-43bf-833b-fb7260b6c4c7-metrics-client-ca\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478198 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478125 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/643340d1-8d20-43bf-833b-fb7260b6c4c7-metrics-client-ca\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478198 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478151 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643340d1-8d20-43bf-833b-fb7260b6c4c7-sys\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478352 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478249 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-wtmp\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478352 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478289 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/643340d1-8d20-43bf-833b-fb7260b6c4c7-root\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478352 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478316 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h626l\" (UniqueName: \"kubernetes.io/projected/643340d1-8d20-43bf-833b-fb7260b6c4c7-kube-api-access-h626l\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478516 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478360 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-textfile\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478516 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478388 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478516 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478387 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-accelerators-collector-config\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478516 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/643340d1-8d20-43bf-833b-fb7260b6c4c7-root\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478739 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478632 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-wtmp\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.478880 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.478861 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-textfile\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.480955 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.480929 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.481731 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.481709 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643340d1-8d20-43bf-833b-fb7260b6c4c7-node-exporter-tls\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.486606 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.486544 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h626l\" (UniqueName: \"kubernetes.io/projected/643340d1-8d20-43bf-833b-fb7260b6c4c7-kube-api-access-h626l\") pod \"node-exporter-psd7n\" (UID: \"643340d1-8d20-43bf-833b-fb7260b6c4c7\") " pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.595831 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.595756 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-psd7n" Jun 02 17:01:46.604068 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:46.604040 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643340d1_8d20_43bf_833b_fb7260b6c4c7.slice/crio-b221e60d571f60f6f283605316cde216aa721a92720b2a354a1c13704ee37d43 WatchSource:0}: Error finding container b221e60d571f60f6f283605316cde216aa721a92720b2a354a1c13704ee37d43: Status 404 returned error can't find the container with id b221e60d571f60f6f283605316cde216aa721a92720b2a354a1c13704ee37d43 Jun 02 17:01:46.933897 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:46.933818 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-psd7n" event={"ID":"643340d1-8d20-43bf-833b-fb7260b6c4c7","Type":"ContainerStarted","Data":"b221e60d571f60f6f283605316cde216aa721a92720b2a354a1c13704ee37d43"} Jun 02 17:01:47.311883 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.311839 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:01:47.315755 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.315702 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.318451 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.318426 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 17:01:47.318604 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.318479 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 17:01:47.318812 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.318795 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 17:01:47.318812 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.318805 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 17:01:47.318976 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.318956 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 17:01:47.319141 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.319104 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 17:01:47.320526 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.320156 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2gv2s\"" Jun 02 17:01:47.320526 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.320184 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 17:01:47.320526 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.320327 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 17:01:47.320526 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.320410 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 17:01:47.329933 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.329898 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:01:47.387022 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.386994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387150 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387064 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387150 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387266 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387266 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387209 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387266 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rklhv\" (UniqueName: \"kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-kube-api-access-rklhv\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387404 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-web-config\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387404 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-config-out\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387404 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387387 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387522 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387418 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-tls-assets\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387522 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-config-volume\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387522 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.387660 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.387531 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488097 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488061 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488253 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488116 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rklhv\" (UniqueName: \"kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-kube-api-access-rklhv\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488253 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488147 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-web-config\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488253 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488192 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-config-out\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488253 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488217 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488253 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488248 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-tls-assets\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488569 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488281 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-config-volume\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488569 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488312 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488569 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488354 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488569 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488386 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488569 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488415 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488569 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488449 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488569 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488485 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488569 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.488495 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.488944 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:47.488634 2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 02 17:01:47.488944 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:47.488735 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-main-tls podName:552b6c3e-887a-4599-aa0a-33ee57918478 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:47.988685121 +0000 UTC m=+182.107647715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478") : secret "alertmanager-main-tls" not found Jun 02 17:01:47.489480 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:47.489102 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-trusted-ca-bundle podName:552b6c3e-887a-4599-aa0a-33ee57918478 nodeName:}" failed. No retries permitted until 2026-06-02 17:01:47.989085106 +0000 UTC m=+182.108047715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478") : configmap references non-existent config key: ca-bundle.crt Jun 02 17:01:47.492718 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.492694 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.493290 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.493267 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.494447 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.493630 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.494447 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.494337 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.494610 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.494532 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-config-out\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.495051 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.494997 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-tls-assets\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.495156 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.495140 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.495216 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.495175 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-web-config\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.495592 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.495543 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-config-volume\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.499576 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.499519 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rklhv\" (UniqueName: \"kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-kube-api-access-rklhv\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.938178 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.938113 2561 generic.go:358] "Generic (PLEG): container finished" podID="643340d1-8d20-43bf-833b-fb7260b6c4c7" containerID="42bc6b25fd9bb793b53f55426bebd8d62d7051ab02c3781a0919342df10477b3" exitCode=0 Jun 02 17:01:47.938290 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.938195 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-psd7n" event={"ID":"643340d1-8d20-43bf-833b-fb7260b6c4c7","Type":"ContainerDied","Data":"42bc6b25fd9bb793b53f55426bebd8d62d7051ab02c3781a0919342df10477b3"} Jun 02 17:01:47.993458 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.993415 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.993649 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.993623 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.994458 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.994431 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:47.995862 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:47.995835 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:48.228521 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:48.228491 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:01:48.357430 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:48.357400 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:01:48.361052 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:48.361023 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552b6c3e_887a_4599_aa0a_33ee57918478.slice/crio-8a5cb95f4084bbccf1c68bc40bc6e49f9e75a17bbdcdf775955c677e772a2d80 WatchSource:0}: Error finding container 8a5cb95f4084bbccf1c68bc40bc6e49f9e75a17bbdcdf775955c677e772a2d80: Status 404 returned error can't find the container with id 8a5cb95f4084bbccf1c68bc40bc6e49f9e75a17bbdcdf775955c677e772a2d80 Jun 02 17:01:48.942328 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:48.942289 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerStarted","Data":"8a5cb95f4084bbccf1c68bc40bc6e49f9e75a17bbdcdf775955c677e772a2d80"} Jun 02 17:01:48.944100 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:48.944074 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-psd7n" event={"ID":"643340d1-8d20-43bf-833b-fb7260b6c4c7","Type":"ContainerStarted","Data":"54699b930eb49196a9afcb3eaf2a815eb6776853baa03567ae9bed8068b7c552"} Jun 02 17:01:48.944218 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:48.944104 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-psd7n" event={"ID":"643340d1-8d20-43bf-833b-fb7260b6c4c7","Type":"ContainerStarted","Data":"0c6a8cc34a0f8743b262dbdc68d45e11837e792b87c7483b48a63c7ab9fa41ab"} Jun 02 17:01:48.979194 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:48.979152 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-psd7n" podStartSLOduration=1.9106526160000001 podStartE2EDuration="2.979139297s" podCreationTimestamp="2026-06-02 17:01:46 +0000 UTC" firstStartedPulling="2026-06-02 17:01:46.60592974 +0000 UTC m=+180.724892336" lastFinishedPulling="2026-06-02 17:01:47.67441642 +0000 UTC m=+181.793379017" observedRunningTime="2026-06-02 17:01:48.978293584 +0000 UTC m=+183.097256198" watchObservedRunningTime="2026-06-02 17:01:48.979139297 +0000 UTC m=+183.098101922" Jun 02 17:01:49.947833 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:49.947752 2561 generic.go:358] "Generic (PLEG): container finished" podID="552b6c3e-887a-4599-aa0a-33ee57918478" containerID="52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3" exitCode=0 Jun 02 17:01:49.947833 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:49.947822 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerDied","Data":"52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3"} Jun 02 17:01:51.422839 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.422808 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-559dffdb56-wj5vt"] Jun 02 17:01:51.425930 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.425905 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.428912 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.428595 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-plskw\"" Jun 02 17:01:51.428912 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.428609 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 17:01:51.428912 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.428604 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 17:01:51.428912 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.428636 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 17:01:51.428912 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.428605 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 17:01:51.429694 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.429674 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 17:01:51.435508 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.435326 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 17:01:51.436592 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.436572 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-559dffdb56-wj5vt"] Jun 02 17:01:51.524564 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.524515 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-secret-telemeter-client\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.524748 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.524583 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-telemeter-client-tls\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.524748 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.524643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-metrics-client-ca\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.524748 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.524697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-serving-certs-ca-bundle\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.524748 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.524732 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-federate-client-tls\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.524926 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.524818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.524926 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.524876 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.525017 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.524939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nln76\" (UniqueName: \"kubernetes.io/projected/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-kube-api-access-nln76\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.626015 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.625971 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-secret-telemeter-client\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.626181 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.626057 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-telemeter-client-tls\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.626181 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.626106 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-metrics-client-ca\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.626181 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.626153 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-serving-certs-ca-bundle\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.626181 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.626173 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-federate-client-tls\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.626375 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.626197 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.626375 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.626246 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.626375 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.626302 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nln76\" (UniqueName: \"kubernetes.io/projected/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-kube-api-access-nln76\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.627459 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.626959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-serving-certs-ca-bundle\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.627459 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.627116 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-metrics-client-ca\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.627459 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.627411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.629061 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.629030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.629169 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.629154 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-telemeter-client-tls\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.629229 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.629195 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-secret-telemeter-client\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.629718 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.629698 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-federate-client-tls\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.633901 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.633880 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nln76\" (UniqueName: \"kubernetes.io/projected/5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9-kube-api-access-nln76\") pod \"telemeter-client-559dffdb56-wj5vt\" (UID: \"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9\") " pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.737668 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.737646 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" Jun 02 17:01:51.877480 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.877454 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-559dffdb56-wj5vt"] Jun 02 17:01:51.881140 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:01:51.881113 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c99fbb4_c1de_40bf_8e3a_cf90bf1082a9.slice/crio-18f41057437355aba86a342e57d57cef4b74204453f8ffe9362d04e6ee0e65f4 WatchSource:0}: Error finding container 18f41057437355aba86a342e57d57cef4b74204453f8ffe9362d04e6ee0e65f4: Status 404 returned error can't find the container with id 18f41057437355aba86a342e57d57cef4b74204453f8ffe9362d04e6ee0e65f4 Jun 02 17:01:51.955274 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.955249 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerStarted","Data":"66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157"} Jun 02 17:01:51.955367 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.955285 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerStarted","Data":"96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760"} Jun 02 17:01:51.955367 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.955299 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerStarted","Data":"67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226"} Jun 02 17:01:51.956225 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:51.956197 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" event={"ID":"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9","Type":"ContainerStarted","Data":"18f41057437355aba86a342e57d57cef4b74204453f8ffe9362d04e6ee0e65f4"} Jun 02 17:01:52.962280 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:52.962237 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerStarted","Data":"bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837"} Jun 02 17:01:52.962636 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:52.962284 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerStarted","Data":"01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b"} Jun 02 17:01:52.962636 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:52.962299 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerStarted","Data":"8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30"} Jun 02 17:01:52.988701 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:52.988529 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.693561639 podStartE2EDuration="5.988512864s" podCreationTimestamp="2026-06-02 17:01:47 +0000 UTC" firstStartedPulling="2026-06-02 17:01:48.362875962 +0000 UTC m=+182.481838555" lastFinishedPulling="2026-06-02 17:01:52.657827176 +0000 UTC m=+186.776789780" observedRunningTime="2026-06-02 17:01:52.988256165 +0000 UTC m=+187.107218802" watchObservedRunningTime="2026-06-02 17:01:52.988512864 +0000 UTC m=+187.107475478" Jun 02 17:01:53.400741 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:53.400672 2561 scope.go:117] "RemoveContainer" containerID="75ea91672056777a7f38cf052916237c0906b534b2ade9029eb23045a49b0f39" Jun 02 17:01:53.400926 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:01:53.400904 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-5h7fn_openshift-console-operator(d9e6780a-6384-4cdc-8c10-9380f591dd22)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" podUID="d9e6780a-6384-4cdc-8c10-9380f591dd22" Jun 02 17:01:54.972302 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:54.972265 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" event={"ID":"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9","Type":"ContainerStarted","Data":"25467bb2144c5612002fb039b291f117b9c4e1b3dfae9c19a6a26190365a5ba7"} Jun 02 17:01:54.972650 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:54.972310 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" event={"ID":"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9","Type":"ContainerStarted","Data":"bef3619b445502aa1fc74e439ac33fd5eb3bd9b900078d1f4e9a9c31ab2b9cb4"} Jun 02 17:01:54.972650 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:54.972325 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" event={"ID":"5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9","Type":"ContainerStarted","Data":"46ff277788d413d1702fbabb1c12a542e87ae25b584b23fcb81b7dabfa4461bc"} Jun 02 17:01:54.994942 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:01:54.994899 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-559dffdb56-wj5vt" podStartSLOduration=1.228270198 podStartE2EDuration="3.994886652s" podCreationTimestamp="2026-06-02 17:01:51 +0000 UTC" firstStartedPulling="2026-06-02 17:01:51.883372086 +0000 UTC m=+186.002334691" lastFinishedPulling="2026-06-02 17:01:54.64998854 +0000 UTC m=+188.768951145" observedRunningTime="2026-06-02 17:01:54.994250185 +0000 UTC m=+189.113212801" watchObservedRunningTime="2026-06-02 17:01:54.994886652 +0000 UTC m=+189.113849266" Jun 02 17:02:01.926220 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:01.926190 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-796676d6bb-p6b6h" Jun 02 17:02:05.399753 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:05.399723 2561 scope.go:117] "RemoveContainer" containerID="75ea91672056777a7f38cf052916237c0906b534b2ade9029eb23045a49b0f39" Jun 02 17:02:06.002313 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.002280 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/2.log" Jun 02 17:02:06.002469 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.002383 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" event={"ID":"d9e6780a-6384-4cdc-8c10-9380f591dd22","Type":"ContainerStarted","Data":"bf35155c446c5f2ede120def6a5313b04dac7b80e57849c708f4c5e2540bf561"} Jun 02 17:02:06.002770 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.002743 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:02:06.022032 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.021975 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" podStartSLOduration=50.824213443 podStartE2EDuration="54.021957918s" podCreationTimestamp="2026-06-02 17:01:12 +0000 UTC" firstStartedPulling="2026-06-02 17:01:12.611303101 +0000 UTC m=+146.730265694" lastFinishedPulling="2026-06-02 17:01:15.809047571 +0000 UTC m=+149.928010169" observedRunningTime="2026-06-02 17:02:06.019402086 +0000 UTC m=+200.138364702" watchObservedRunningTime="2026-06-02 17:02:06.021957918 +0000 UTC m=+200.140920547" Jun 02 17:02:06.419907 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.419834 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-5h7fn" Jun 02 17:02:06.601225 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.601190 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-z46gs"] Jun 02 17:02:06.604586 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.604564 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-z46gs" Jun 02 17:02:06.607598 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.607578 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 17:02:06.607721 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.607620 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 17:02:06.607721 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.607646 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qc967\"" Jun 02 17:02:06.612485 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.612463 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-z46gs"] Jun 02 17:02:06.756269 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.756243 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c7z2\" (UniqueName: \"kubernetes.io/projected/436bcf83-7c6f-4794-9bba-cddc9d3c4f04-kube-api-access-6c7z2\") pod \"downloads-c65b8dc4b-z46gs\" (UID: \"436bcf83-7c6f-4794-9bba-cddc9d3c4f04\") " pod="openshift-console/downloads-c65b8dc4b-z46gs" Jun 02 17:02:06.856650 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.856624 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6c7z2\" (UniqueName: \"kubernetes.io/projected/436bcf83-7c6f-4794-9bba-cddc9d3c4f04-kube-api-access-6c7z2\") pod \"downloads-c65b8dc4b-z46gs\" (UID: \"436bcf83-7c6f-4794-9bba-cddc9d3c4f04\") " pod="openshift-console/downloads-c65b8dc4b-z46gs" Jun 02 17:02:06.867937 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.867914 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c7z2\" (UniqueName: \"kubernetes.io/projected/436bcf83-7c6f-4794-9bba-cddc9d3c4f04-kube-api-access-6c7z2\") pod \"downloads-c65b8dc4b-z46gs\" (UID: \"436bcf83-7c6f-4794-9bba-cddc9d3c4f04\") " pod="openshift-console/downloads-c65b8dc4b-z46gs" Jun 02 17:02:06.914259 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:06.914237 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-z46gs" Jun 02 17:02:07.038088 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:07.038063 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-z46gs"] Jun 02 17:02:07.040076 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:02:07.040049 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436bcf83_7c6f_4794_9bba_cddc9d3c4f04.slice/crio-aed6cac36de59af482897719d0f5d93ab830d71fc263c0d11cb9d77f0ca44f6e WatchSource:0}: Error finding container aed6cac36de59af482897719d0f5d93ab830d71fc263c0d11cb9d77f0ca44f6e: Status 404 returned error can't find the container with id aed6cac36de59af482897719d0f5d93ab830d71fc263c0d11cb9d77f0ca44f6e Jun 02 17:02:08.009122 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:08.009078 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-z46gs" event={"ID":"436bcf83-7c6f-4794-9bba-cddc9d3c4f04","Type":"ContainerStarted","Data":"aed6cac36de59af482897719d0f5d93ab830d71fc263c0d11cb9d77f0ca44f6e"} Jun 02 17:02:17.206461 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.206427 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f9b8cbfb-r2g4q"] Jun 02 17:02:17.212854 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.212834 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.215975 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.215956 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 17:02:17.217349 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.217321 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 17:02:17.217571 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.217360 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 17:02:17.217571 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.217381 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4nls9\"" Jun 02 17:02:17.217571 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.217360 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 17:02:17.218604 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.218151 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 17:02:17.221318 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.221296 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f9b8cbfb-r2g4q"] Jun 02 17:02:17.359178 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.359146 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-serving-cert\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.359325 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.359178 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-oauth-config\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.359325 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.359245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-oauth-serving-cert\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.359325 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.359312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29cn5\" (UniqueName: \"kubernetes.io/projected/0f171603-fd62-4a7a-984c-d76bed5ecf0f-kube-api-access-29cn5\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.359421 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.359335 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-config\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.359421 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.359411 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-service-ca\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.460396 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.460324 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-service-ca\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.460528 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.460428 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-serving-cert\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.460528 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.460455 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-oauth-config\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.460528 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.460497 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-oauth-serving-cert\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.460673 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.460529 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-29cn5\" (UniqueName: \"kubernetes.io/projected/0f171603-fd62-4a7a-984c-d76bed5ecf0f-kube-api-access-29cn5\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.460673 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.460574 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-config\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.461143 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.461095 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-service-ca\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.461259 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.461191 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-oauth-serving-cert\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.461314 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.461252 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-config\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.462771 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.462753 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-serving-cert\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.462853 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.462781 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-oauth-config\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.468271 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.468251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29cn5\" (UniqueName: \"kubernetes.io/projected/0f171603-fd62-4a7a-984c-d76bed5ecf0f-kube-api-access-29cn5\") pod \"console-59f9b8cbfb-r2g4q\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:17.525157 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:17.525133 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:24.298113 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:24.298056 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f9b8cbfb-r2g4q"] Jun 02 17:02:24.308921 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:02:24.308894 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f171603_fd62_4a7a_984c_d76bed5ecf0f.slice/crio-64f1108d70f83c43fc78515742dfcc7b8de427aa6a334ee470d5f3c47fee14e3 WatchSource:0}: Error finding container 64f1108d70f83c43fc78515742dfcc7b8de427aa6a334ee470d5f3c47fee14e3: Status 404 returned error can't find the container with id 64f1108d70f83c43fc78515742dfcc7b8de427aa6a334ee470d5f3c47fee14e3 Jun 02 17:02:25.063669 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:25.063602 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f9b8cbfb-r2g4q" event={"ID":"0f171603-fd62-4a7a-984c-d76bed5ecf0f","Type":"ContainerStarted","Data":"64f1108d70f83c43fc78515742dfcc7b8de427aa6a334ee470d5f3c47fee14e3"} Jun 02 17:02:25.066064 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:25.066017 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-z46gs" event={"ID":"436bcf83-7c6f-4794-9bba-cddc9d3c4f04","Type":"ContainerStarted","Data":"814112aa46ce79eb92a3acafeb63a64a6101ad2c63c7b1e20819f3240f97215d"} Jun 02 17:02:25.066479 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:25.066441 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-z46gs" Jun 02 17:02:25.077922 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:25.077865 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-z46gs" Jun 02 17:02:25.085901 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:25.085847 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-z46gs" podStartSLOduration=1.858868838 podStartE2EDuration="19.085830945s" podCreationTimestamp="2026-06-02 17:02:06 +0000 UTC" firstStartedPulling="2026-06-02 17:02:07.044453298 +0000 UTC m=+201.163415891" lastFinishedPulling="2026-06-02 17:02:24.271415402 +0000 UTC m=+218.390377998" observedRunningTime="2026-06-02 17:02:25.083706411 +0000 UTC m=+219.202669027" watchObservedRunningTime="2026-06-02 17:02:25.085830945 +0000 UTC m=+219.204793564" Jun 02 17:02:26.502812 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.502776 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-74f566bcbd-kw9zd"] Jun 02 17:02:26.523598 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.523531 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f566bcbd-kw9zd"] Jun 02 17:02:26.523863 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.523707 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.531866 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.531666 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 17:02:26.544342 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.544293 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-oauth-serving-cert\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.544465 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.544346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-service-ca\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.544465 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.544400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdj76\" (UniqueName: \"kubernetes.io/projected/d706338f-0aad-4465-a445-d0fad1db15d2-kube-api-access-hdj76\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.544465 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.544435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-serving-cert\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.544728 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.544465 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-oauth-config\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.544728 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.544487 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-trusted-ca-bundle\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.544728 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.544617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-console-config\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.645966 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.645917 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-console-config\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.646143 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.645989 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-oauth-serving-cert\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.646143 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.646025 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-service-ca\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.646143 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.646082 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdj76\" (UniqueName: \"kubernetes.io/projected/d706338f-0aad-4465-a445-d0fad1db15d2-kube-api-access-hdj76\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.646143 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.646119 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-serving-cert\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.646370 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.646146 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-oauth-config\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.646370 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.646173 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-trusted-ca-bundle\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.646839 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.646703 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-console-config\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.646839 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.646759 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-oauth-serving-cert\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.646839 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.646839 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-service-ca\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.647165 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.647146 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-trusted-ca-bundle\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.651406 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.649794 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-serving-cert\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.651406 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.650161 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-oauth-config\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.654398 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.654374 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdj76\" (UniqueName: \"kubernetes.io/projected/d706338f-0aad-4465-a445-d0fad1db15d2-kube-api-access-hdj76\") pod \"console-74f566bcbd-kw9zd\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:26.865853 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:26.865771 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:27.074807 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:27.074767 2561 generic.go:358] "Generic (PLEG): container finished" podID="7f53cb65-c3c4-423f-bfdd-0095e4877922" containerID="698119c5856f7db4b00ecd394aa7b69c4198b4676618161d3fa1bc040660847a" exitCode=0 Jun 02 17:02:27.075839 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:27.075166 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" event={"ID":"7f53cb65-c3c4-423f-bfdd-0095e4877922","Type":"ContainerDied","Data":"698119c5856f7db4b00ecd394aa7b69c4198b4676618161d3fa1bc040660847a"} Jun 02 17:02:27.075839 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:27.075535 2561 scope.go:117] "RemoveContainer" containerID="698119c5856f7db4b00ecd394aa7b69c4198b4676618161d3fa1bc040660847a" Jun 02 17:02:28.153749 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:28.153720 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74f566bcbd-kw9zd"] Jun 02 17:02:29.084998 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:29.084909 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-5mxm7" event={"ID":"7f53cb65-c3c4-423f-bfdd-0095e4877922","Type":"ContainerStarted","Data":"b3ecec0a61b052978de24fe4b3abc393c88fff927b3caa3b113e20bbfc36dbe7"} Jun 02 17:02:29.086855 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:29.086826 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f9b8cbfb-r2g4q" event={"ID":"0f171603-fd62-4a7a-984c-d76bed5ecf0f","Type":"ContainerStarted","Data":"648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099"} Jun 02 17:02:29.088356 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:29.088330 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f566bcbd-kw9zd" event={"ID":"d706338f-0aad-4465-a445-d0fad1db15d2","Type":"ContainerStarted","Data":"a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc"} Jun 02 17:02:29.088463 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:29.088363 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f566bcbd-kw9zd" event={"ID":"d706338f-0aad-4465-a445-d0fad1db15d2","Type":"ContainerStarted","Data":"33e2122417d87c95dedb0213b9087127bd2260077812480db49ba9dfa3d9fb03"} Jun 02 17:02:29.117963 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:29.117896 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-59f9b8cbfb-r2g4q" podStartSLOduration=7.953315411 podStartE2EDuration="12.11788148s" podCreationTimestamp="2026-06-02 17:02:17 +0000 UTC" firstStartedPulling="2026-06-02 17:02:24.310665074 +0000 UTC m=+218.429627667" lastFinishedPulling="2026-06-02 17:02:28.475231117 +0000 UTC m=+222.594193736" observedRunningTime="2026-06-02 17:02:29.115989565 +0000 UTC m=+223.234952181" watchObservedRunningTime="2026-06-02 17:02:29.11788148 +0000 UTC m=+223.236844094" Jun 02 17:02:29.132432 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:29.132379 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-74f566bcbd-kw9zd" podStartSLOduration=2.567158764 podStartE2EDuration="3.132363801s" podCreationTimestamp="2026-06-02 17:02:26 +0000 UTC" firstStartedPulling="2026-06-02 17:02:28.163309075 +0000 UTC m=+222.282271670" lastFinishedPulling="2026-06-02 17:02:28.728514099 +0000 UTC m=+222.847476707" observedRunningTime="2026-06-02 17:02:29.130808888 +0000 UTC m=+223.249771503" watchObservedRunningTime="2026-06-02 17:02:29.132363801 +0000 UTC m=+223.251326416" Jun 02 17:02:30.092667 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:30.092632 2561 generic.go:358] "Generic (PLEG): container finished" podID="17b93277-b713-4313-a736-79af364b1c86" containerID="7ee2a70393867954e9844c18fed76a81a04bd9260103ca9d588d8f08c3fce4f5" exitCode=0 Jun 02 17:02:30.093013 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:30.092704 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-wg6tm" event={"ID":"17b93277-b713-4313-a736-79af364b1c86","Type":"ContainerDied","Data":"7ee2a70393867954e9844c18fed76a81a04bd9260103ca9d588d8f08c3fce4f5"} Jun 02 17:02:30.093133 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:30.093112 2561 scope.go:117] "RemoveContainer" containerID="7ee2a70393867954e9844c18fed76a81a04bd9260103ca9d588d8f08c3fce4f5" Jun 02 17:02:30.856683 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:30.856653 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w4rwh_08960404-6b30-4974-a440-37b70c47fbe9/dns/0.log" Jun 02 17:02:30.862573 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:30.862518 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w4rwh_08960404-6b30-4974-a440-37b70c47fbe9/kube-rbac-proxy/0.log" Jun 02 17:02:31.017284 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:31.017254 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6kfb_8024b137-910f-4a08-8257-4ac1d69fcb73/dns-node-resolver/0.log" Jun 02 17:02:31.097845 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:31.097808 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-wg6tm" event={"ID":"17b93277-b713-4313-a736-79af364b1c86","Type":"ContainerStarted","Data":"7bf496f677b22c22f81592e9ac19c9b02107529868049aa3cf5885099ed599dd"} Jun 02 17:02:32.103259 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:32.103224 2561 generic.go:358] "Generic (PLEG): container finished" podID="540118e7-6648-4bd6-80d3-4fae5f384a6d" containerID="d92ec0f6e7c2199653016d484e14d5b25837d3c9d7995ec2234884160aa50264" exitCode=0 Jun 02 17:02:32.103756 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:32.103266 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" event={"ID":"540118e7-6648-4bd6-80d3-4fae5f384a6d","Type":"ContainerDied","Data":"d92ec0f6e7c2199653016d484e14d5b25837d3c9d7995ec2234884160aa50264"} Jun 02 17:02:32.103756 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:32.103666 2561 scope.go:117] "RemoveContainer" containerID="d92ec0f6e7c2199653016d484e14d5b25837d3c9d7995ec2234884160aa50264" Jun 02 17:02:33.109421 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:33.109373 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-jrhpc" event={"ID":"540118e7-6648-4bd6-80d3-4fae5f384a6d","Type":"ContainerStarted","Data":"6bf531099424b103262c1871798ac2bee3bd9dd086951efcbcda94c64552fc24"} Jun 02 17:02:36.866189 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:36.866156 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:36.866189 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:36.866196 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:36.870835 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:36.870811 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:37.124217 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:37.124142 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:02:37.168505 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:37.168467 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f9b8cbfb-r2g4q"] Jun 02 17:02:37.525934 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:37.525903 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:02:58.129500 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:58.129390 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 17:02:58.131599 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:58.131577 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7d51764-e935-4acf-a016-44f761ffb245-metrics-certs\") pod \"network-metrics-daemon-dfg6z\" (UID: \"e7d51764-e935-4acf-a016-44f761ffb245\") " pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 17:02:58.306768 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:58.306725 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t5b29\"" Jun 02 17:02:58.315080 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:58.315062 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfg6z" Jun 02 17:02:58.431731 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:58.431706 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dfg6z"] Jun 02 17:02:58.434157 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:02:58.434128 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d51764_e935_4acf_a016_44f761ffb245.slice/crio-3bf50e0bb6e9f4314fc57c9e7aeecdb390c55a28097903b62e1511b848b1f12e WatchSource:0}: Error finding container 3bf50e0bb6e9f4314fc57c9e7aeecdb390c55a28097903b62e1511b848b1f12e: Status 404 returned error can't find the container with id 3bf50e0bb6e9f4314fc57c9e7aeecdb390c55a28097903b62e1511b848b1f12e Jun 02 17:02:59.185599 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:02:59.185542 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dfg6z" event={"ID":"e7d51764-e935-4acf-a016-44f761ffb245","Type":"ContainerStarted","Data":"3bf50e0bb6e9f4314fc57c9e7aeecdb390c55a28097903b62e1511b848b1f12e"} Jun 02 17:03:00.190356 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:00.190317 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dfg6z" event={"ID":"e7d51764-e935-4acf-a016-44f761ffb245","Type":"ContainerStarted","Data":"e9ffd5b9154f3802d0471a9d0660684e7bb8c836bf1322f971f63467d2938b2c"} Jun 02 17:03:01.194865 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:01.194827 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dfg6z" event={"ID":"e7d51764-e935-4acf-a016-44f761ffb245","Type":"ContainerStarted","Data":"80c9d1df5154bfebe7a1aed869b0de4039c835e3d72e2d4cceaf08ffea638986"} Jun 02 17:03:01.212169 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:01.212121 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dfg6z" podStartSLOduration=253.689580791 podStartE2EDuration="4m15.212109085s" podCreationTimestamp="2026-06-02 16:58:46 +0000 UTC" firstStartedPulling="2026-06-02 17:02:58.436082674 +0000 UTC m=+252.555045283" lastFinishedPulling="2026-06-02 17:02:59.95861098 +0000 UTC m=+254.077573577" observedRunningTime="2026-06-02 17:03:01.209521221 +0000 UTC m=+255.328483833" watchObservedRunningTime="2026-06-02 17:03:01.212109085 +0000 UTC m=+255.331071741" Jun 02 17:03:02.188232 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.188192 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-59f9b8cbfb-r2g4q" podUID="0f171603-fd62-4a7a-984c-d76bed5ecf0f" containerName="console" containerID="cri-o://648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099" gracePeriod=15 Jun 02 17:03:02.451640 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.451620 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59f9b8cbfb-r2g4q_0f171603-fd62-4a7a-984c-d76bed5ecf0f/console/0.log" Jun 02 17:03:02.451942 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.451690 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:03:02.468216 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.468196 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-oauth-config\") pod \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " Jun 02 17:03:02.468293 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.468236 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-serving-cert\") pod \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " Jun 02 17:03:02.468293 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.468270 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-service-ca\") pod \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " Jun 02 17:03:02.468384 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.468301 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-config\") pod \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " Jun 02 17:03:02.468384 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.468322 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-oauth-serving-cert\") pod \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " Jun 02 17:03:02.468384 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.468359 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29cn5\" (UniqueName: \"kubernetes.io/projected/0f171603-fd62-4a7a-984c-d76bed5ecf0f-kube-api-access-29cn5\") pod \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\" (UID: \"0f171603-fd62-4a7a-984c-d76bed5ecf0f\") " Jun 02 17:03:02.468897 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.468842 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-config" (OuterVolumeSpecName: "console-config") pod "0f171603-fd62-4a7a-984c-d76bed5ecf0f" (UID: "0f171603-fd62-4a7a-984c-d76bed5ecf0f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:02.469047 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.468881 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0f171603-fd62-4a7a-984c-d76bed5ecf0f" (UID: "0f171603-fd62-4a7a-984c-d76bed5ecf0f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:02.469133 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.469037 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-service-ca" (OuterVolumeSpecName: "service-ca") pod "0f171603-fd62-4a7a-984c-d76bed5ecf0f" (UID: "0f171603-fd62-4a7a-984c-d76bed5ecf0f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:02.470965 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.470937 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0f171603-fd62-4a7a-984c-d76bed5ecf0f" (UID: "0f171603-fd62-4a7a-984c-d76bed5ecf0f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:02.471160 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.471020 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0f171603-fd62-4a7a-984c-d76bed5ecf0f" (UID: "0f171603-fd62-4a7a-984c-d76bed5ecf0f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:02.471341 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.471308 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f171603-fd62-4a7a-984c-d76bed5ecf0f-kube-api-access-29cn5" (OuterVolumeSpecName: "kube-api-access-29cn5") pod "0f171603-fd62-4a7a-984c-d76bed5ecf0f" (UID: "0f171603-fd62-4a7a-984c-d76bed5ecf0f"). InnerVolumeSpecName "kube-api-access-29cn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:03:02.569570 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.569523 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29cn5\" (UniqueName: \"kubernetes.io/projected/0f171603-fd62-4a7a-984c-d76bed5ecf0f-kube-api-access-29cn5\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:02.569570 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.569571 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-oauth-config\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:02.569764 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.569586 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-serving-cert\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:02.569764 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.569601 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-service-ca\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:02.569764 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.569615 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-console-config\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:02.569764 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:02.569626 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f171603-fd62-4a7a-984c-d76bed5ecf0f-oauth-serving-cert\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:03.202815 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:03.202788 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59f9b8cbfb-r2g4q_0f171603-fd62-4a7a-984c-d76bed5ecf0f/console/0.log" Jun 02 17:03:03.203019 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:03.202828 2561 generic.go:358] "Generic (PLEG): container finished" podID="0f171603-fd62-4a7a-984c-d76bed5ecf0f" containerID="648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099" exitCode=2 Jun 02 17:03:03.203019 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:03.202861 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f9b8cbfb-r2g4q" event={"ID":"0f171603-fd62-4a7a-984c-d76bed5ecf0f","Type":"ContainerDied","Data":"648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099"} Jun 02 17:03:03.203019 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:03.202902 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f9b8cbfb-r2g4q" Jun 02 17:03:03.203019 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:03.202920 2561 scope.go:117] "RemoveContainer" containerID="648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099" Jun 02 17:03:03.203178 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:03.202908 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f9b8cbfb-r2g4q" event={"ID":"0f171603-fd62-4a7a-984c-d76bed5ecf0f","Type":"ContainerDied","Data":"64f1108d70f83c43fc78515742dfcc7b8de427aa6a334ee470d5f3c47fee14e3"} Jun 02 17:03:03.213182 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:03.213163 2561 scope.go:117] "RemoveContainer" containerID="648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099" Jun 02 17:03:03.213832 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:03:03.213804 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099\": container with ID starting with 648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099 not found: ID does not exist" containerID="648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099" Jun 02 17:03:03.213938 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:03.213840 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099"} err="failed to get container status \"648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099\": rpc error: code = NotFound desc = could not find container \"648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099\": container with ID starting with 648a79bfb23eb3b6a3c71fd0d3e085a81854fe31df2d410360f8449a55044099 not found: ID does not exist" Jun 02 17:03:03.228234 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:03.228204 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f9b8cbfb-r2g4q"] Jun 02 17:03:03.233637 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:03.233615 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f9b8cbfb-r2g4q"] Jun 02 17:03:04.404041 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:04.404014 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f171603-fd62-4a7a-984c-d76bed5ecf0f" path="/var/lib/kubelet/pods/0f171603-fd62-4a7a-984c-d76bed5ecf0f/volumes" Jun 02 17:03:06.536407 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.536375 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:03:06.537024 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.536988 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="alertmanager" containerID="cri-o://67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226" gracePeriod=120 Jun 02 17:03:06.537113 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.537031 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy-metric" containerID="cri-o://01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b" gracePeriod=120 Jun 02 17:03:06.537113 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.537082 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy" containerID="cri-o://8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30" gracePeriod=120 Jun 02 17:03:06.537113 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.537078 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="prom-label-proxy" containerID="cri-o://bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837" gracePeriod=120 Jun 02 17:03:06.537289 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.537063 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy-web" containerID="cri-o://66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157" gracePeriod=120 Jun 02 17:03:06.537289 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.537125 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="config-reloader" containerID="cri-o://96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760" gracePeriod=120 Jun 02 17:03:06.806462 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.806385 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ccd48cd-9gpl9"] Jun 02 17:03:06.806742 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.806726 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f171603-fd62-4a7a-984c-d76bed5ecf0f" containerName="console" Jun 02 17:03:06.806795 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.806744 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f171603-fd62-4a7a-984c-d76bed5ecf0f" containerName="console" Jun 02 17:03:06.806829 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.806804 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="0f171603-fd62-4a7a-984c-d76bed5ecf0f" containerName="console" Jun 02 17:03:06.825951 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.825927 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ccd48cd-9gpl9"] Jun 02 17:03:06.826085 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.826064 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:06.903084 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.903053 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc4tm\" (UniqueName: \"kubernetes.io/projected/69ff07e6-8967-4bba-919c-1604b95e0b23-kube-api-access-fc4tm\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:06.903268 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.903116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-console-config\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:06.903268 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.903147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-service-ca\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:06.903268 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.903193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-oauth-config\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:06.903268 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.903220 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-serving-cert\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:06.903268 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.903263 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-oauth-serving-cert\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:06.903510 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:06.903334 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-trusted-ca-bundle\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.004053 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.004020 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-service-ca\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.004228 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.004070 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-oauth-config\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.004228 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.004087 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-serving-cert\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.004228 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.004105 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-oauth-serving-cert\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.004228 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.004148 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-trusted-ca-bundle\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.004228 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.004184 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc4tm\" (UniqueName: \"kubernetes.io/projected/69ff07e6-8967-4bba-919c-1604b95e0b23-kube-api-access-fc4tm\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.004228 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.004225 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-console-config\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.004905 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.004879 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-console-config\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.005030 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.004904 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-oauth-serving-cert\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.005030 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.004889 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-service-ca\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.005146 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.005028 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-trusted-ca-bundle\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.006634 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.006611 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-oauth-config\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.006712 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.006697 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-serving-cert\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.011800 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.011779 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc4tm\" (UniqueName: \"kubernetes.io/projected/69ff07e6-8967-4bba-919c-1604b95e0b23-kube-api-access-fc4tm\") pod \"console-5ccd48cd-9gpl9\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.134894 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.134826 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:07.220830 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.220800 2561 generic.go:358] "Generic (PLEG): container finished" podID="552b6c3e-887a-4599-aa0a-33ee57918478" containerID="bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837" exitCode=0 Jun 02 17:03:07.220830 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.220824 2561 generic.go:358] "Generic (PLEG): container finished" podID="552b6c3e-887a-4599-aa0a-33ee57918478" containerID="8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30" exitCode=0 Jun 02 17:03:07.220830 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.220832 2561 generic.go:358] "Generic (PLEG): container finished" podID="552b6c3e-887a-4599-aa0a-33ee57918478" containerID="96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760" exitCode=0 Jun 02 17:03:07.220830 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.220838 2561 generic.go:358] "Generic (PLEG): container finished" podID="552b6c3e-887a-4599-aa0a-33ee57918478" containerID="67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226" exitCode=0 Jun 02 17:03:07.221123 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.220863 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerDied","Data":"bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837"} Jun 02 17:03:07.221123 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.220917 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerDied","Data":"8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30"} Jun 02 17:03:07.221123 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.220935 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerDied","Data":"96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760"} Jun 02 17:03:07.221123 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.220950 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerDied","Data":"67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226"} Jun 02 17:03:07.260722 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.260598 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ccd48cd-9gpl9"] Jun 02 17:03:07.263468 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:03:07.263438 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ff07e6_8967_4bba_919c_1604b95e0b23.slice/crio-7076b9495f021b7e16635878c180c9c0dafd18f4a2daee70f5a6139b08f63dac WatchSource:0}: Error finding container 7076b9495f021b7e16635878c180c9c0dafd18f4a2daee70f5a6139b08f63dac: Status 404 returned error can't find the container with id 7076b9495f021b7e16635878c180c9c0dafd18f4a2daee70f5a6139b08f63dac Jun 02 17:03:07.805771 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.805748 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:07.912763 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.912688 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-web-config\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.912763 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.912733 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-config-volume\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.912763 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.912751 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-metric\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.913027 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.912780 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-tls-assets\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.913027 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.912802 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-cluster-tls-config\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.913027 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.912828 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-config-out\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.913027 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.912945 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rklhv\" (UniqueName: \"kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-kube-api-access-rklhv\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.913027 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.912986 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-trusted-ca-bundle\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.913027 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.913015 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-main-tls\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.913331 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.913045 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-web\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.913331 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.913102 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-metrics-client-ca\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.913331 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.913192 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-main-db\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.913331 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.913227 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy\") pod \"552b6c3e-887a-4599-aa0a-33ee57918478\" (UID: \"552b6c3e-887a-4599-aa0a-33ee57918478\") " Jun 02 17:03:07.915402 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.915376 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:07.915926 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.915570 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-config-volume" (OuterVolumeSpecName: "config-volume") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:07.916069 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.915717 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:07.916166 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.916144 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:03:07.916238 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.916204 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:07.916238 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.915743 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 17:03:07.916344 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.915912 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-config-out" (OuterVolumeSpecName: "config-out") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 17:03:07.916344 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.915952 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:07.916344 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.916059 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:07.917412 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.917385 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-kube-api-access-rklhv" (OuterVolumeSpecName: "kube-api-access-rklhv") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "kube-api-access-rklhv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:03:07.917967 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.917948 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:07.920142 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.920122 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:07.925758 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:07.925739 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-web-config" (OuterVolumeSpecName: "web-config") pod "552b6c3e-887a-4599-aa0a-33ee57918478" (UID: "552b6c3e-887a-4599-aa0a-33ee57918478"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:08.014801 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014768 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-main-db\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.014801 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014798 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014812 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-web-config\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014826 2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-config-volume\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014840 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014853 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-tls-assets\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014867 2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-cluster-tls-config\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014879 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/552b6c3e-887a-4599-aa0a-33ee57918478-config-out\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014892 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rklhv\" (UniqueName: \"kubernetes.io/projected/552b6c3e-887a-4599-aa0a-33ee57918478-kube-api-access-rklhv\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014904 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014917 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-main-tls\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014930 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/552b6c3e-887a-4599-aa0a-33ee57918478-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.015003 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.014944 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/552b6c3e-887a-4599-aa0a-33ee57918478-metrics-client-ca\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:08.226654 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.226623 2561 generic.go:358] "Generic (PLEG): container finished" podID="552b6c3e-887a-4599-aa0a-33ee57918478" containerID="01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b" exitCode=0 Jun 02 17:03:08.226654 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.226647 2561 generic.go:358] "Generic (PLEG): container finished" podID="552b6c3e-887a-4599-aa0a-33ee57918478" containerID="66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157" exitCode=0 Jun 02 17:03:08.226855 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.226710 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerDied","Data":"01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b"} Jun 02 17:03:08.226855 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.226741 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.226855 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.226757 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerDied","Data":"66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157"} Jun 02 17:03:08.226855 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.226776 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"552b6c3e-887a-4599-aa0a-33ee57918478","Type":"ContainerDied","Data":"8a5cb95f4084bbccf1c68bc40bc6e49f9e75a17bbdcdf775955c677e772a2d80"} Jun 02 17:03:08.226855 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.226797 2561 scope.go:117] "RemoveContainer" containerID="bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837" Jun 02 17:03:08.228175 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.228153 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccd48cd-9gpl9" event={"ID":"69ff07e6-8967-4bba-919c-1604b95e0b23","Type":"ContainerStarted","Data":"621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b"} Jun 02 17:03:08.228296 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.228183 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccd48cd-9gpl9" event={"ID":"69ff07e6-8967-4bba-919c-1604b95e0b23","Type":"ContainerStarted","Data":"7076b9495f021b7e16635878c180c9c0dafd18f4a2daee70f5a6139b08f63dac"} Jun 02 17:03:08.234463 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.234447 2561 scope.go:117] "RemoveContainer" containerID="01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b" Jun 02 17:03:08.241008 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.240993 2561 scope.go:117] "RemoveContainer" containerID="8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30" Jun 02 17:03:08.247241 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.247223 2561 scope.go:117] "RemoveContainer" containerID="66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157" Jun 02 17:03:08.250267 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.250231 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5ccd48cd-9gpl9" podStartSLOduration=2.2502198829999998 podStartE2EDuration="2.250219883s" podCreationTimestamp="2026-06-02 17:03:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:03:08.248673839 +0000 UTC m=+262.367636469" watchObservedRunningTime="2026-06-02 17:03:08.250219883 +0000 UTC m=+262.369182498" Jun 02 17:03:08.253895 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.253879 2561 scope.go:117] "RemoveContainer" containerID="96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760" Jun 02 17:03:08.260023 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.260007 2561 scope.go:117] "RemoveContainer" containerID="67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226" Jun 02 17:03:08.263959 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.263936 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:03:08.266791 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.266776 2561 scope.go:117] "RemoveContainer" containerID="52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3" Jun 02 17:03:08.270933 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.270913 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:03:08.273309 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.273289 2561 scope.go:117] "RemoveContainer" containerID="bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837" Jun 02 17:03:08.273564 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:03:08.273534 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837\": container with ID starting with bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837 not found: ID does not exist" containerID="bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837" Jun 02 17:03:08.273637 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.273572 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837"} err="failed to get container status \"bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837\": rpc error: code = NotFound desc = could not find container \"bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837\": container with ID starting with bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837 not found: ID does not exist" Jun 02 17:03:08.273637 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.273594 2561 scope.go:117] "RemoveContainer" containerID="01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b" Jun 02 17:03:08.273810 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:03:08.273793 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b\": container with ID starting with 01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b not found: ID does not exist" containerID="01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b" Jun 02 17:03:08.273856 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.273814 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b"} err="failed to get container status \"01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b\": rpc error: code = NotFound desc = could not find container \"01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b\": container with ID starting with 01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b not found: ID does not exist" Jun 02 17:03:08.273856 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.273827 2561 scope.go:117] "RemoveContainer" containerID="8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30" Jun 02 17:03:08.274006 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:03:08.273991 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30\": container with ID starting with 8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30 not found: ID does not exist" containerID="8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30" Jun 02 17:03:08.274048 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.274009 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30"} err="failed to get container status \"8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30\": rpc error: code = NotFound desc = could not find container \"8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30\": container with ID starting with 8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30 not found: ID does not exist" Jun 02 17:03:08.274048 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.274020 2561 scope.go:117] "RemoveContainer" containerID="66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157" Jun 02 17:03:08.274215 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:03:08.274199 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157\": container with ID starting with 66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157 not found: ID does not exist" containerID="66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157" Jun 02 17:03:08.274253 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.274219 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157"} err="failed to get container status \"66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157\": rpc error: code = NotFound desc = could not find container \"66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157\": container with ID starting with 66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157 not found: ID does not exist" Jun 02 17:03:08.274253 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.274230 2561 scope.go:117] "RemoveContainer" containerID="96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760" Jun 02 17:03:08.274436 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:03:08.274418 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760\": container with ID starting with 96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760 not found: ID does not exist" containerID="96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760" Jun 02 17:03:08.274496 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.274445 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760"} err="failed to get container status \"96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760\": rpc error: code = NotFound desc = could not find container \"96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760\": container with ID starting with 96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760 not found: ID does not exist" Jun 02 17:03:08.274496 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.274468 2561 scope.go:117] "RemoveContainer" containerID="67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226" Jun 02 17:03:08.274686 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:03:08.274672 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226\": container with ID starting with 67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226 not found: ID does not exist" containerID="67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226" Jun 02 17:03:08.274728 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.274689 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226"} err="failed to get container status \"67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226\": rpc error: code = NotFound desc = could not find container \"67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226\": container with ID starting with 67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226 not found: ID does not exist" Jun 02 17:03:08.274728 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.274700 2561 scope.go:117] "RemoveContainer" containerID="52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3" Jun 02 17:03:08.274870 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:03:08.274857 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3\": container with ID starting with 52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3 not found: ID does not exist" containerID="52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3" Jun 02 17:03:08.274930 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.274872 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3"} err="failed to get container status \"52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3\": rpc error: code = NotFound desc = could not find container \"52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3\": container with ID starting with 52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3 not found: ID does not exist" Jun 02 17:03:08.274930 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.274883 2561 scope.go:117] "RemoveContainer" containerID="bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837" Jun 02 17:03:08.275067 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.275053 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837"} err="failed to get container status \"bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837\": rpc error: code = NotFound desc = could not find container \"bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837\": container with ID starting with bd27b85f63184366d0cbc1b433940085fee551760dedad1b29c8f3c27ead2837 not found: ID does not exist" Jun 02 17:03:08.275110 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.275067 2561 scope.go:117] "RemoveContainer" containerID="01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b" Jun 02 17:03:08.275222 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.275208 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b"} err="failed to get container status \"01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b\": rpc error: code = NotFound desc = could not find container \"01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b\": container with ID starting with 01a259cd3fa69af2b867bf45912a330250fb3fc5e60767f7aefaa6d097901e1b not found: ID does not exist" Jun 02 17:03:08.275269 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.275222 2561 scope.go:117] "RemoveContainer" containerID="8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30" Jun 02 17:03:08.275417 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.275403 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30"} err="failed to get container status \"8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30\": rpc error: code = NotFound desc = could not find container \"8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30\": container with ID starting with 8e5d18f8aefcc369e37e2b96ff32b89525afc166c1892fbdf45bee2acfca6a30 not found: ID does not exist" Jun 02 17:03:08.275461 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.275416 2561 scope.go:117] "RemoveContainer" containerID="66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157" Jun 02 17:03:08.275642 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.275624 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157"} err="failed to get container status \"66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157\": rpc error: code = NotFound desc = could not find container \"66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157\": container with ID starting with 66e2b672c6dcd06384979182a533e0529ad9dad1fd0e2518c59fc3a50b040157 not found: ID does not exist" Jun 02 17:03:08.275692 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.275642 2561 scope.go:117] "RemoveContainer" containerID="96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760" Jun 02 17:03:08.275858 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.275839 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760"} err="failed to get container status \"96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760\": rpc error: code = NotFound desc = could not find container \"96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760\": container with ID starting with 96400241dbc9a490b49f42fa22cd999dc9ed5b4c9170ba801558f9b050d7c760 not found: ID does not exist" Jun 02 17:03:08.275926 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.275860 2561 scope.go:117] "RemoveContainer" containerID="67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226" Jun 02 17:03:08.276082 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.276066 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226"} err="failed to get container status \"67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226\": rpc error: code = NotFound desc = could not find container \"67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226\": container with ID starting with 67e7d28c723244195de61a67a88b4fac2e2d3f1fd20d4dbfe43cb87f2a960226 not found: ID does not exist" Jun 02 17:03:08.276131 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.276085 2561 scope.go:117] "RemoveContainer" containerID="52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3" Jun 02 17:03:08.276273 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.276257 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3"} err="failed to get container status \"52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3\": rpc error: code = NotFound desc = could not find container \"52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3\": container with ID starting with 52a7e54845813c52229c01ed51b2f8458866c02ddd43c87ddbb4d27d139647f3 not found: ID does not exist" Jun 02 17:03:08.294252 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294228 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:03:08.294516 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294504 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="alertmanager" Jun 02 17:03:08.294577 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294517 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="alertmanager" Jun 02 17:03:08.294577 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294527 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy-metric" Jun 02 17:03:08.294577 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294533 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy-metric" Jun 02 17:03:08.294577 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294540 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy" Jun 02 17:03:08.294577 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294546 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy" Jun 02 17:03:08.294577 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294570 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy-web" Jun 02 17:03:08.294577 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294575 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy-web" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294582 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="prom-label-proxy" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294586 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="prom-label-proxy" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294599 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="config-reloader" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294604 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="config-reloader" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294610 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="init-config-reloader" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294614 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="init-config-reloader" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294657 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="alertmanager" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294665 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="config-reloader" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294671 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy-web" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294678 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294685 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="kube-rbac-proxy-metric" Jun 02 17:03:08.294818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.294691 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" containerName="prom-label-proxy" Jun 02 17:03:08.328619 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.328600 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:03:08.328743 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.328733 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.331902 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.331881 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 17:03:08.332034 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.332016 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 17:03:08.332200 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.332183 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 17:03:08.332328 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.332220 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 17:03:08.332405 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.332325 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 17:03:08.332405 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.332337 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 17:03:08.332539 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.332439 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 17:03:08.332539 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.332457 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 17:03:08.332539 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.332462 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2gv2s\"" Jun 02 17:03:08.340036 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.340012 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 17:03:08.404245 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.404214 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="552b6c3e-887a-4599-aa0a-33ee57918478" path="/var/lib/kubelet/pods/552b6c3e-887a-4599-aa0a-33ee57918478/volumes" Jun 02 17:03:08.418857 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.418834 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.418932 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.418863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8911916-081f-4607-b334-c6995cdf80b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.418932 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.418882 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62xrh\" (UniqueName: \"kubernetes.io/projected/d8911916-081f-4607-b334-c6995cdf80b8-kube-api-access-62xrh\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.419009 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.418949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8911916-081f-4607-b334-c6995cdf80b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.419009 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.418973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-web-config\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.419068 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.419035 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.419100 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.419074 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8911916-081f-4607-b334-c6995cdf80b8-config-out\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.419100 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.419092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.419160 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.419121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8911916-081f-4607-b334-c6995cdf80b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.419160 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.419150 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.419233 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.419193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.419233 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.419219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8911916-081f-4607-b334-c6995cdf80b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.419303 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.419277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520004 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.519925 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520004 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.519962 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8911916-081f-4607-b334-c6995cdf80b8-config-out\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520004 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.519980 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520004 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.519998 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8911916-081f-4607-b334-c6995cdf80b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520292 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.520016 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520292 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.520150 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520292 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.520200 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8911916-081f-4607-b334-c6995cdf80b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520292 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.520243 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520502 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.520292 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520502 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.520323 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8911916-081f-4607-b334-c6995cdf80b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520502 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.520355 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62xrh\" (UniqueName: \"kubernetes.io/projected/d8911916-081f-4607-b334-c6995cdf80b8-kube-api-access-62xrh\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520502 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.520419 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8911916-081f-4607-b334-c6995cdf80b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.520502 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.520450 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-web-config\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.521618 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.520994 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8911916-081f-4607-b334-c6995cdf80b8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.521618 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.521016 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8911916-081f-4607-b334-c6995cdf80b8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.521618 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.521576 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8911916-081f-4607-b334-c6995cdf80b8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.522871 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.522798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8911916-081f-4607-b334-c6995cdf80b8-config-out\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.522871 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.522838 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.523123 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.523101 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.523123 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.523117 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-web-config\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.523281 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.523263 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.523467 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.523451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8911916-081f-4607-b334-c6995cdf80b8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.523905 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.523887 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.524606 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.524590 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.524775 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.524758 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8911916-081f-4607-b334-c6995cdf80b8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.529004 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.528983 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62xrh\" (UniqueName: \"kubernetes.io/projected/d8911916-081f-4607-b334-c6995cdf80b8-kube-api-access-62xrh\") pod \"alertmanager-main-0\" (UID: \"d8911916-081f-4607-b334-c6995cdf80b8\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.642180 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.642153 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 17:03:08.773575 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:08.773535 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 17:03:08.775566 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:03:08.775529 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8911916_081f_4607_b334_c6995cdf80b8.slice/crio-03e981b45cb68c914c915d47a16135bf402d5df86a8fa165a2b92c7d073e26ae WatchSource:0}: Error finding container 03e981b45cb68c914c915d47a16135bf402d5df86a8fa165a2b92c7d073e26ae: Status 404 returned error can't find the container with id 03e981b45cb68c914c915d47a16135bf402d5df86a8fa165a2b92c7d073e26ae Jun 02 17:03:09.235525 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:09.235490 2561 generic.go:358] "Generic (PLEG): container finished" podID="d8911916-081f-4607-b334-c6995cdf80b8" containerID="23360f7060920799022b5ee948da3f9ad1dcf14f84f7886a1a24d2a4ec496811" exitCode=0 Jun 02 17:03:09.235918 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:09.235580 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8911916-081f-4607-b334-c6995cdf80b8","Type":"ContainerDied","Data":"23360f7060920799022b5ee948da3f9ad1dcf14f84f7886a1a24d2a4ec496811"} Jun 02 17:03:09.235918 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:09.235622 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8911916-081f-4607-b334-c6995cdf80b8","Type":"ContainerStarted","Data":"03e981b45cb68c914c915d47a16135bf402d5df86a8fa165a2b92c7d073e26ae"} Jun 02 17:03:10.242239 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:10.242203 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8911916-081f-4607-b334-c6995cdf80b8","Type":"ContainerStarted","Data":"cd737d0c96c9a8b84d5138876e470fd19b01c9b14db37da1a6c2070343ca5b7c"} Jun 02 17:03:10.242239 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:10.242242 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8911916-081f-4607-b334-c6995cdf80b8","Type":"ContainerStarted","Data":"e7d120378573803989fff2d85236c781d6e8da12110c1ce6c92044ee50c52e99"} Jun 02 17:03:10.242777 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:10.242253 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8911916-081f-4607-b334-c6995cdf80b8","Type":"ContainerStarted","Data":"6ec92a384a36792e029e3cfb87d3f0259222d9237ef62da68888863fb12e2e79"} Jun 02 17:03:10.242777 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:10.242262 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8911916-081f-4607-b334-c6995cdf80b8","Type":"ContainerStarted","Data":"9a03d1a7311e62f6ab0380a97945bcabfa7e835b9924d03be396314ab98721cd"} Jun 02 17:03:10.242777 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:10.242270 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8911916-081f-4607-b334-c6995cdf80b8","Type":"ContainerStarted","Data":"c9e1f96365dfd62ec3470c3d5b45bd034eb3e405134fb2729b9dd591e2b4214e"} Jun 02 17:03:10.242777 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:10.242279 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8911916-081f-4607-b334-c6995cdf80b8","Type":"ContainerStarted","Data":"e7679a90af391b1c18d95716f2deee52e9e27a2900494e4e2048f4a821313754"} Jun 02 17:03:10.270376 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:10.270336 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.2703209429999998 podStartE2EDuration="2.270320943s" podCreationTimestamp="2026-06-02 17:03:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:03:10.267675827 +0000 UTC m=+264.386638443" watchObservedRunningTime="2026-06-02 17:03:10.270320943 +0000 UTC m=+264.389283594" Jun 02 17:03:17.135974 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:17.135940 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:17.135974 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:17.135979 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:17.141226 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:17.140800 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:17.266186 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:17.266157 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:03:17.312422 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:17.312392 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f566bcbd-kw9zd"] Jun 02 17:03:42.333178 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.333120 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-74f566bcbd-kw9zd" podUID="d706338f-0aad-4465-a445-d0fad1db15d2" containerName="console" containerID="cri-o://a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc" gracePeriod=15 Jun 02 17:03:42.580561 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.580528 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74f566bcbd-kw9zd_d706338f-0aad-4465-a445-d0fad1db15d2/console/0.log" Jun 02 17:03:42.580675 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.580604 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:03:42.701825 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.701743 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-oauth-config\") pod \"d706338f-0aad-4465-a445-d0fad1db15d2\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " Jun 02 17:03:42.701825 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.701793 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-oauth-serving-cert\") pod \"d706338f-0aad-4465-a445-d0fad1db15d2\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " Jun 02 17:03:42.701825 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.701814 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-serving-cert\") pod \"d706338f-0aad-4465-a445-d0fad1db15d2\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " Jun 02 17:03:42.702066 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.701861 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-console-config\") pod \"d706338f-0aad-4465-a445-d0fad1db15d2\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " Jun 02 17:03:42.702066 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.701892 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-service-ca\") pod \"d706338f-0aad-4465-a445-d0fad1db15d2\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " Jun 02 17:03:42.702066 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.701922 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-trusted-ca-bundle\") pod \"d706338f-0aad-4465-a445-d0fad1db15d2\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " Jun 02 17:03:42.702066 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.701950 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdj76\" (UniqueName: \"kubernetes.io/projected/d706338f-0aad-4465-a445-d0fad1db15d2-kube-api-access-hdj76\") pod \"d706338f-0aad-4465-a445-d0fad1db15d2\" (UID: \"d706338f-0aad-4465-a445-d0fad1db15d2\") " Jun 02 17:03:42.702352 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.702314 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-console-config" (OuterVolumeSpecName: "console-config") pod "d706338f-0aad-4465-a445-d0fad1db15d2" (UID: "d706338f-0aad-4465-a445-d0fad1db15d2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:42.702352 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.702313 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d706338f-0aad-4465-a445-d0fad1db15d2" (UID: "d706338f-0aad-4465-a445-d0fad1db15d2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:42.702526 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.702440 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-service-ca" (OuterVolumeSpecName: "service-ca") pod "d706338f-0aad-4465-a445-d0fad1db15d2" (UID: "d706338f-0aad-4465-a445-d0fad1db15d2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:42.702526 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.702452 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d706338f-0aad-4465-a445-d0fad1db15d2" (UID: "d706338f-0aad-4465-a445-d0fad1db15d2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:03:42.703886 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.703861 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d706338f-0aad-4465-a445-d0fad1db15d2" (UID: "d706338f-0aad-4465-a445-d0fad1db15d2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:42.703995 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.703969 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d706338f-0aad-4465-a445-d0fad1db15d2" (UID: "d706338f-0aad-4465-a445-d0fad1db15d2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:03:42.704077 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.704057 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d706338f-0aad-4465-a445-d0fad1db15d2-kube-api-access-hdj76" (OuterVolumeSpecName: "kube-api-access-hdj76") pod "d706338f-0aad-4465-a445-d0fad1db15d2" (UID: "d706338f-0aad-4465-a445-d0fad1db15d2"). InnerVolumeSpecName "kube-api-access-hdj76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:03:42.802641 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.802607 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-serving-cert\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:42.802641 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.802635 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-console-config\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:42.802641 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.802645 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-service-ca\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:42.802858 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.802654 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-trusted-ca-bundle\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:42.802858 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.802665 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdj76\" (UniqueName: \"kubernetes.io/projected/d706338f-0aad-4465-a445-d0fad1db15d2-kube-api-access-hdj76\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:42.802858 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.802675 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d706338f-0aad-4465-a445-d0fad1db15d2-console-oauth-config\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:42.802858 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:42.802686 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d706338f-0aad-4465-a445-d0fad1db15d2-oauth-serving-cert\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:03:43.336712 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:43.336685 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-74f566bcbd-kw9zd_d706338f-0aad-4465-a445-d0fad1db15d2/console/0.log" Jun 02 17:03:43.337160 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:43.336727 2561 generic.go:358] "Generic (PLEG): container finished" podID="d706338f-0aad-4465-a445-d0fad1db15d2" containerID="a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc" exitCode=2 Jun 02 17:03:43.337160 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:43.336767 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f566bcbd-kw9zd" event={"ID":"d706338f-0aad-4465-a445-d0fad1db15d2","Type":"ContainerDied","Data":"a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc"} Jun 02 17:03:43.337160 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:43.336794 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74f566bcbd-kw9zd" Jun 02 17:03:43.337160 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:43.336822 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74f566bcbd-kw9zd" event={"ID":"d706338f-0aad-4465-a445-d0fad1db15d2","Type":"ContainerDied","Data":"33e2122417d87c95dedb0213b9087127bd2260077812480db49ba9dfa3d9fb03"} Jun 02 17:03:43.337160 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:43.336846 2561 scope.go:117] "RemoveContainer" containerID="a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc" Jun 02 17:03:43.346842 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:43.346826 2561 scope.go:117] "RemoveContainer" containerID="a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc" Jun 02 17:03:43.347100 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:03:43.347081 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc\": container with ID starting with a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc not found: ID does not exist" containerID="a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc" Jun 02 17:03:43.347165 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:43.347114 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc"} err="failed to get container status \"a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc\": rpc error: code = NotFound desc = could not find container \"a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc\": container with ID starting with a34dd0e46b5a297b21c9d82c668c4293ce9c57824e459b4d1fb17546512b52fc not found: ID does not exist" Jun 02 17:03:43.359271 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:43.359244 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74f566bcbd-kw9zd"] Jun 02 17:03:43.362533 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:43.362509 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74f566bcbd-kw9zd"] Jun 02 17:03:44.403957 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:44.403922 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d706338f-0aad-4465-a445-d0fad1db15d2" path="/var/lib/kubelet/pods/d706338f-0aad-4465-a445-d0fad1db15d2/volumes" Jun 02 17:03:46.309930 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:46.309628 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/2.log" Jun 02 17:03:46.310391 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:46.310370 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/2.log" Jun 02 17:03:46.318134 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:46.318108 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 17:03:46.318843 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:46.318822 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 17:03:46.321500 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:03:46.321487 2561 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 17:06:18.277718 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.277634 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5tvm7"] Jun 02 17:06:18.278176 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.277934 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d706338f-0aad-4465-a445-d0fad1db15d2" containerName="console" Jun 02 17:06:18.278176 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.277945 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d706338f-0aad-4465-a445-d0fad1db15d2" containerName="console" Jun 02 17:06:18.278176 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.277991 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="d706338f-0aad-4465-a445-d0fad1db15d2" containerName="console" Jun 02 17:06:18.280747 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.280726 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.283232 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.283206 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 17:06:18.293731 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.293705 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5tvm7"] Jun 02 17:06:18.348000 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.347968 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5b03c69-df2f-48d0-8669-cb3431fe80b5-original-pull-secret\") pod \"global-pull-secret-syncer-5tvm7\" (UID: \"c5b03c69-df2f-48d0-8669-cb3431fe80b5\") " pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.348174 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.348064 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5b03c69-df2f-48d0-8669-cb3431fe80b5-kubelet-config\") pod \"global-pull-secret-syncer-5tvm7\" (UID: \"c5b03c69-df2f-48d0-8669-cb3431fe80b5\") " pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.348174 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.348139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5b03c69-df2f-48d0-8669-cb3431fe80b5-dbus\") pod \"global-pull-secret-syncer-5tvm7\" (UID: \"c5b03c69-df2f-48d0-8669-cb3431fe80b5\") " pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.449602 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.449543 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5b03c69-df2f-48d0-8669-cb3431fe80b5-dbus\") pod \"global-pull-secret-syncer-5tvm7\" (UID: \"c5b03c69-df2f-48d0-8669-cb3431fe80b5\") " pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.449799 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.449623 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5b03c69-df2f-48d0-8669-cb3431fe80b5-original-pull-secret\") pod \"global-pull-secret-syncer-5tvm7\" (UID: \"c5b03c69-df2f-48d0-8669-cb3431fe80b5\") " pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.449799 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.449669 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5b03c69-df2f-48d0-8669-cb3431fe80b5-kubelet-config\") pod \"global-pull-secret-syncer-5tvm7\" (UID: \"c5b03c69-df2f-48d0-8669-cb3431fe80b5\") " pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.449799 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.449740 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5b03c69-df2f-48d0-8669-cb3431fe80b5-dbus\") pod \"global-pull-secret-syncer-5tvm7\" (UID: \"c5b03c69-df2f-48d0-8669-cb3431fe80b5\") " pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.449799 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.449760 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5b03c69-df2f-48d0-8669-cb3431fe80b5-kubelet-config\") pod \"global-pull-secret-syncer-5tvm7\" (UID: \"c5b03c69-df2f-48d0-8669-cb3431fe80b5\") " pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.451985 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.451963 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5b03c69-df2f-48d0-8669-cb3431fe80b5-original-pull-secret\") pod \"global-pull-secret-syncer-5tvm7\" (UID: \"c5b03c69-df2f-48d0-8669-cb3431fe80b5\") " pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.590271 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.590167 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5tvm7" Jun 02 17:06:18.718371 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.718292 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5tvm7"] Jun 02 17:06:18.721295 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:06:18.721267 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b03c69_df2f_48d0_8669_cb3431fe80b5.slice/crio-14e7f5dddba80fec80549b275cf7e6a1320d991bd51cdfef39f2bbc74d16ce75 WatchSource:0}: Error finding container 14e7f5dddba80fec80549b275cf7e6a1320d991bd51cdfef39f2bbc74d16ce75: Status 404 returned error can't find the container with id 14e7f5dddba80fec80549b275cf7e6a1320d991bd51cdfef39f2bbc74d16ce75 Jun 02 17:06:18.722917 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.722900 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 17:06:18.772196 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:18.772165 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5tvm7" event={"ID":"c5b03c69-df2f-48d0-8669-cb3431fe80b5","Type":"ContainerStarted","Data":"14e7f5dddba80fec80549b275cf7e6a1320d991bd51cdfef39f2bbc74d16ce75"} Jun 02 17:06:23.790361 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:23.790323 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5tvm7" event={"ID":"c5b03c69-df2f-48d0-8669-cb3431fe80b5","Type":"ContainerStarted","Data":"bd59604cffb6e3f3a337fdb860b9e87f930492794eb250f49966da8f49ff3132"} Jun 02 17:06:23.805415 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:23.805362 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5tvm7" podStartSLOduration=1.644016927 podStartE2EDuration="5.805347972s" podCreationTimestamp="2026-06-02 17:06:18 +0000 UTC" firstStartedPulling="2026-06-02 17:06:18.723025473 +0000 UTC m=+452.841988065" lastFinishedPulling="2026-06-02 17:06:22.884356483 +0000 UTC m=+457.003319110" observedRunningTime="2026-06-02 17:06:23.804086721 +0000 UTC m=+457.923049334" watchObservedRunningTime="2026-06-02 17:06:23.805347972 +0000 UTC m=+457.924310586" Jun 02 17:06:51.082879 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.082844 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt"] Jun 02 17:06:51.086449 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.086432 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.089388 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.089362 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzlvq\"" Jun 02 17:06:51.089528 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.089398 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 17:06:51.090598 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.090577 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 17:06:51.094047 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.094022 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt"] Jun 02 17:06:51.122108 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.122059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.122277 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.122131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbsmk\" (UniqueName: \"kubernetes.io/projected/61fd1f62-b590-4e5a-904d-5686313d5130-kube-api-access-bbsmk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.122277 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.122181 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.223174 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.223132 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.223426 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.223195 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bbsmk\" (UniqueName: \"kubernetes.io/projected/61fd1f62-b590-4e5a-904d-5686313d5130-kube-api-access-bbsmk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.223426 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.223254 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.223592 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.223544 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.223676 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.223654 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.231136 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.231115 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbsmk\" (UniqueName: \"kubernetes.io/projected/61fd1f62-b590-4e5a-904d-5686313d5130-kube-api-access-bbsmk\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.396845 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.396753 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:06:51.523434 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.523408 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt"] Jun 02 17:06:51.526128 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:06:51.526099 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61fd1f62_b590_4e5a_904d_5686313d5130.slice/crio-8fa99d38ce47dd57bb7178386b1b5b82af57d39d7ab4aa896f8c36698885bf3e WatchSource:0}: Error finding container 8fa99d38ce47dd57bb7178386b1b5b82af57d39d7ab4aa896f8c36698885bf3e: Status 404 returned error can't find the container with id 8fa99d38ce47dd57bb7178386b1b5b82af57d39d7ab4aa896f8c36698885bf3e Jun 02 17:06:51.871018 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:51.870983 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" event={"ID":"61fd1f62-b590-4e5a-904d-5686313d5130","Type":"ContainerStarted","Data":"8fa99d38ce47dd57bb7178386b1b5b82af57d39d7ab4aa896f8c36698885bf3e"} Jun 02 17:06:58.893615 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:58.893577 2561 generic.go:358] "Generic (PLEG): container finished" podID="61fd1f62-b590-4e5a-904d-5686313d5130" containerID="6f1214fbd7315818e62a203592639be3c0a505475f9606c712bf8794c1586a1e" exitCode=0 Jun 02 17:06:58.893970 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:06:58.893643 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" event={"ID":"61fd1f62-b590-4e5a-904d-5686313d5130","Type":"ContainerDied","Data":"6f1214fbd7315818e62a203592639be3c0a505475f9606c712bf8794c1586a1e"} Jun 02 17:07:00.901524 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:00.901449 2561 generic.go:358] "Generic (PLEG): container finished" podID="61fd1f62-b590-4e5a-904d-5686313d5130" containerID="59685608de7770e4b8097d79db3de9f57fc6721adfe3a1bd54eb49d80cca1bff" exitCode=0 Jun 02 17:07:00.901877 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:00.901528 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" event={"ID":"61fd1f62-b590-4e5a-904d-5686313d5130","Type":"ContainerDied","Data":"59685608de7770e4b8097d79db3de9f57fc6721adfe3a1bd54eb49d80cca1bff"} Jun 02 17:07:09.932057 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:09.932017 2561 generic.go:358] "Generic (PLEG): container finished" podID="61fd1f62-b590-4e5a-904d-5686313d5130" containerID="b48ea7d5462f566e4369f0489337c757eda58ca625b621fa25d499d1f06cb8ec" exitCode=0 Jun 02 17:07:09.932434 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:09.932122 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" event={"ID":"61fd1f62-b590-4e5a-904d-5686313d5130","Type":"ContainerDied","Data":"b48ea7d5462f566e4369f0489337c757eda58ca625b621fa25d499d1f06cb8ec"} Jun 02 17:07:11.052890 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.052869 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:07:11.199939 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.199853 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-util\") pod \"61fd1f62-b590-4e5a-904d-5686313d5130\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " Jun 02 17:07:11.199939 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.199899 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-bundle\") pod \"61fd1f62-b590-4e5a-904d-5686313d5130\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " Jun 02 17:07:11.199939 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.199940 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbsmk\" (UniqueName: \"kubernetes.io/projected/61fd1f62-b590-4e5a-904d-5686313d5130-kube-api-access-bbsmk\") pod \"61fd1f62-b590-4e5a-904d-5686313d5130\" (UID: \"61fd1f62-b590-4e5a-904d-5686313d5130\") " Jun 02 17:07:11.200592 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.200546 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-bundle" (OuterVolumeSpecName: "bundle") pod "61fd1f62-b590-4e5a-904d-5686313d5130" (UID: "61fd1f62-b590-4e5a-904d-5686313d5130"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 17:07:11.202132 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.202110 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61fd1f62-b590-4e5a-904d-5686313d5130-kube-api-access-bbsmk" (OuterVolumeSpecName: "kube-api-access-bbsmk") pod "61fd1f62-b590-4e5a-904d-5686313d5130" (UID: "61fd1f62-b590-4e5a-904d-5686313d5130"). InnerVolumeSpecName "kube-api-access-bbsmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:07:11.203755 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.203734 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-util" (OuterVolumeSpecName: "util") pod "61fd1f62-b590-4e5a-904d-5686313d5130" (UID: "61fd1f62-b590-4e5a-904d-5686313d5130"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 17:07:11.301313 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.301275 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-util\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:07:11.301313 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.301309 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/61fd1f62-b590-4e5a-904d-5686313d5130-bundle\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:07:11.301313 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.301319 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbsmk\" (UniqueName: \"kubernetes.io/projected/61fd1f62-b590-4e5a-904d-5686313d5130-kube-api-access-bbsmk\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:07:11.939182 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.939146 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" event={"ID":"61fd1f62-b590-4e5a-904d-5686313d5130","Type":"ContainerDied","Data":"8fa99d38ce47dd57bb7178386b1b5b82af57d39d7ab4aa896f8c36698885bf3e"} Jun 02 17:07:11.939182 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.939180 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fa99d38ce47dd57bb7178386b1b5b82af57d39d7ab4aa896f8c36698885bf3e" Jun 02 17:07:11.939182 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:11.939186 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dsplnt" Jun 02 17:07:18.894403 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.894370 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs"] Jun 02 17:07:18.894774 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.894677 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61fd1f62-b590-4e5a-904d-5686313d5130" containerName="util" Jun 02 17:07:18.894774 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.894689 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="61fd1f62-b590-4e5a-904d-5686313d5130" containerName="util" Jun 02 17:07:18.894774 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.894697 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61fd1f62-b590-4e5a-904d-5686313d5130" containerName="pull" Jun 02 17:07:18.894774 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.894703 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="61fd1f62-b590-4e5a-904d-5686313d5130" containerName="pull" Jun 02 17:07:18.894774 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.894711 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61fd1f62-b590-4e5a-904d-5686313d5130" containerName="extract" Jun 02 17:07:18.894774 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.894717 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="61fd1f62-b590-4e5a-904d-5686313d5130" containerName="extract" Jun 02 17:07:18.894774 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.894768 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="61fd1f62-b590-4e5a-904d-5686313d5130" containerName="extract" Jun 02 17:07:18.900046 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.900030 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" Jun 02 17:07:18.902829 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.902806 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 17:07:18.902957 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.902805 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 17:07:18.902957 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.902809 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p8fdd\"" Jun 02 17:07:18.906462 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:18.906442 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs"] Jun 02 17:07:19.062051 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:19.062016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18022ff6-fd9a-4e3e-8957-13ead4783def-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-vwxcs\" (UID: \"18022ff6-fd9a-4e3e-8957-13ead4783def\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" Jun 02 17:07:19.062199 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:19.062075 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgvz2\" (UniqueName: \"kubernetes.io/projected/18022ff6-fd9a-4e3e-8957-13ead4783def-kube-api-access-rgvz2\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-vwxcs\" (UID: \"18022ff6-fd9a-4e3e-8957-13ead4783def\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" Jun 02 17:07:19.163405 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:19.163329 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rgvz2\" (UniqueName: \"kubernetes.io/projected/18022ff6-fd9a-4e3e-8957-13ead4783def-kube-api-access-rgvz2\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-vwxcs\" (UID: \"18022ff6-fd9a-4e3e-8957-13ead4783def\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" Jun 02 17:07:19.163529 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:19.163405 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18022ff6-fd9a-4e3e-8957-13ead4783def-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-vwxcs\" (UID: \"18022ff6-fd9a-4e3e-8957-13ead4783def\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" Jun 02 17:07:19.163819 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:19.163801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18022ff6-fd9a-4e3e-8957-13ead4783def-tmp\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-vwxcs\" (UID: \"18022ff6-fd9a-4e3e-8957-13ead4783def\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" Jun 02 17:07:19.171924 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:19.171901 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgvz2\" (UniqueName: \"kubernetes.io/projected/18022ff6-fd9a-4e3e-8957-13ead4783def-kube-api-access-rgvz2\") pod \"cert-manager-operator-controller-manager-5b47fd69f5-vwxcs\" (UID: \"18022ff6-fd9a-4e3e-8957-13ead4783def\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" Jun 02 17:07:19.210345 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:19.210311 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" Jun 02 17:07:19.343061 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:19.343033 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs"] Jun 02 17:07:19.344854 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:07:19.344828 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18022ff6_fd9a_4e3e_8957_13ead4783def.slice/crio-38083d8800f96353657c116e702c313275801aaadec9a4cd122f178afc72e3b8 WatchSource:0}: Error finding container 38083d8800f96353657c116e702c313275801aaadec9a4cd122f178afc72e3b8: Status 404 returned error can't find the container with id 38083d8800f96353657c116e702c313275801aaadec9a4cd122f178afc72e3b8 Jun 02 17:07:19.963565 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:19.963520 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" event={"ID":"18022ff6-fd9a-4e3e-8957-13ead4783def","Type":"ContainerStarted","Data":"38083d8800f96353657c116e702c313275801aaadec9a4cd122f178afc72e3b8"} Jun 02 17:07:21.971587 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:21.971529 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" event={"ID":"18022ff6-fd9a-4e3e-8957-13ead4783def","Type":"ContainerStarted","Data":"57891754dee15265f385f96d74ae42840473e8d5cf2a224989b8a27049fa49d6"} Jun 02 17:07:21.994511 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:21.994448 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-5b47fd69f5-vwxcs" podStartSLOduration=2.256670947 podStartE2EDuration="3.99443092s" podCreationTimestamp="2026-06-02 17:07:18 +0000 UTC" firstStartedPulling="2026-06-02 17:07:19.347249752 +0000 UTC m=+513.466212345" lastFinishedPulling="2026-06-02 17:07:21.085009721 +0000 UTC m=+515.203972318" observedRunningTime="2026-06-02 17:07:21.991511725 +0000 UTC m=+516.110474340" watchObservedRunningTime="2026-06-02 17:07:21.99443092 +0000 UTC m=+516.113393539" Jun 02 17:07:24.046376 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.046334 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-76cbd4b6bd-7lc2r"] Jun 02 17:07:24.049974 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.049940 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.061252 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.061226 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cbd4b6bd-7lc2r"] Jun 02 17:07:24.063310 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.063290 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-dd9m6"] Jun 02 17:07:24.066507 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.066490 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" Jun 02 17:07:24.069248 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.069219 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 17:07:24.069348 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.069231 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 17:07:24.069417 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.069399 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tv8fq\"" Jun 02 17:07:24.076194 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.076175 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-dd9m6"] Jun 02 17:07:24.207653 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.207617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86805d78-9421-4351-b336-72b5bc568c11-console-serving-cert\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.207813 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.207668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-oauth-serving-cert\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.207813 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.207694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/022c920e-8ed1-4556-85a9-0e625cb78ad8-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-dd9m6\" (UID: \"022c920e-8ed1-4556-85a9-0e625cb78ad8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" Jun 02 17:07:24.207813 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.207740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-service-ca\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.207813 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.207788 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-trusted-ca-bundle\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.207949 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.207817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvtrf\" (UniqueName: \"kubernetes.io/projected/86805d78-9421-4351-b336-72b5bc568c11-kube-api-access-kvtrf\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.207949 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.207894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdkqn\" (UniqueName: \"kubernetes.io/projected/022c920e-8ed1-4556-85a9-0e625cb78ad8-kube-api-access-gdkqn\") pod \"cert-manager-webhook-587ccfb98-dd9m6\" (UID: \"022c920e-8ed1-4556-85a9-0e625cb78ad8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" Jun 02 17:07:24.207949 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.207929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86805d78-9421-4351-b336-72b5bc568c11-console-oauth-config\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.207949 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.207947 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-console-config\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.308956 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.308837 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-service-ca\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.308956 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.308933 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-trusted-ca-bundle\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.309195 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.308978 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvtrf\" (UniqueName: \"kubernetes.io/projected/86805d78-9421-4351-b336-72b5bc568c11-kube-api-access-kvtrf\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.309195 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.309019 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gdkqn\" (UniqueName: \"kubernetes.io/projected/022c920e-8ed1-4556-85a9-0e625cb78ad8-kube-api-access-gdkqn\") pod \"cert-manager-webhook-587ccfb98-dd9m6\" (UID: \"022c920e-8ed1-4556-85a9-0e625cb78ad8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" Jun 02 17:07:24.309195 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.309049 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86805d78-9421-4351-b336-72b5bc568c11-console-oauth-config\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.309195 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.309070 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-console-config\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.309195 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.309096 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86805d78-9421-4351-b336-72b5bc568c11-console-serving-cert\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.309195 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.309140 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-oauth-serving-cert\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.309195 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.309171 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/022c920e-8ed1-4556-85a9-0e625cb78ad8-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-dd9m6\" (UID: \"022c920e-8ed1-4556-85a9-0e625cb78ad8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" Jun 02 17:07:24.309687 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.309666 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-service-ca\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.309854 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.309830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-trusted-ca-bundle\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.309925 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.309901 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-console-config\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.309968 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.309935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/86805d78-9421-4351-b336-72b5bc568c11-oauth-serving-cert\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.311597 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.311579 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/86805d78-9421-4351-b336-72b5bc568c11-console-oauth-config\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.311834 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.311816 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/86805d78-9421-4351-b336-72b5bc568c11-console-serving-cert\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.317405 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.317375 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvtrf\" (UniqueName: \"kubernetes.io/projected/86805d78-9421-4351-b336-72b5bc568c11-kube-api-access-kvtrf\") pod \"console-76cbd4b6bd-7lc2r\" (UID: \"86805d78-9421-4351-b336-72b5bc568c11\") " pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.317612 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.317534 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/022c920e-8ed1-4556-85a9-0e625cb78ad8-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-dd9m6\" (UID: \"022c920e-8ed1-4556-85a9-0e625cb78ad8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" Jun 02 17:07:24.318172 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.318155 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdkqn\" (UniqueName: \"kubernetes.io/projected/022c920e-8ed1-4556-85a9-0e625cb78ad8-kube-api-access-gdkqn\") pod \"cert-manager-webhook-587ccfb98-dd9m6\" (UID: \"022c920e-8ed1-4556-85a9-0e625cb78ad8\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" Jun 02 17:07:24.360738 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.360707 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:24.385597 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.385562 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" Jun 02 17:07:24.516919 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.516895 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76cbd4b6bd-7lc2r"] Jun 02 17:07:24.518998 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:07:24.518969 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86805d78_9421_4351_b336_72b5bc568c11.slice/crio-ddc554b60c437d65a0f4717f429d1276449b00cd707db8cc946e95668847ee7f WatchSource:0}: Error finding container ddc554b60c437d65a0f4717f429d1276449b00cd707db8cc946e95668847ee7f: Status 404 returned error can't find the container with id ddc554b60c437d65a0f4717f429d1276449b00cd707db8cc946e95668847ee7f Jun 02 17:07:24.533459 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.533366 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-dd9m6"] Jun 02 17:07:24.536494 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:07:24.536465 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod022c920e_8ed1_4556_85a9_0e625cb78ad8.slice/crio-1ddd5af47188f6d1c0c22190d06c7b746bdaa4bf9f61e63cee4372fd2980efd4 WatchSource:0}: Error finding container 1ddd5af47188f6d1c0c22190d06c7b746bdaa4bf9f61e63cee4372fd2980efd4: Status 404 returned error can't find the container with id 1ddd5af47188f6d1c0c22190d06c7b746bdaa4bf9f61e63cee4372fd2980efd4 Jun 02 17:07:24.982727 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.982689 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cbd4b6bd-7lc2r" event={"ID":"86805d78-9421-4351-b336-72b5bc568c11","Type":"ContainerStarted","Data":"d1f6d55807f4bd2394861619b56777105e08504b736c623fac8a40e54608b621"} Jun 02 17:07:24.982914 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.982733 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76cbd4b6bd-7lc2r" event={"ID":"86805d78-9421-4351-b336-72b5bc568c11","Type":"ContainerStarted","Data":"ddc554b60c437d65a0f4717f429d1276449b00cd707db8cc946e95668847ee7f"} Jun 02 17:07:24.983717 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:24.983695 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" event={"ID":"022c920e-8ed1-4556-85a9-0e625cb78ad8","Type":"ContainerStarted","Data":"1ddd5af47188f6d1c0c22190d06c7b746bdaa4bf9f61e63cee4372fd2980efd4"} Jun 02 17:07:25.003918 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:25.003862 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-76cbd4b6bd-7lc2r" podStartSLOduration=1.003843616 podStartE2EDuration="1.003843616s" podCreationTimestamp="2026-06-02 17:07:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:07:25.00200945 +0000 UTC m=+519.120972070" watchObservedRunningTime="2026-06-02 17:07:25.003843616 +0000 UTC m=+519.122806232" Jun 02 17:07:27.996545 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:27.996503 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" event={"ID":"022c920e-8ed1-4556-85a9-0e625cb78ad8","Type":"ContainerStarted","Data":"7ef7e01cead3a9b24d259c7a9a88e3fddfcf3ccef041627d8a87e6737e87ab8d"} Jun 02 17:07:27.996956 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:27.996600 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" Jun 02 17:07:28.016958 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:28.016909 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" podStartSLOduration=1.496898559 podStartE2EDuration="4.016893279s" podCreationTimestamp="2026-06-02 17:07:24 +0000 UTC" firstStartedPulling="2026-06-02 17:07:24.538727064 +0000 UTC m=+518.657689657" lastFinishedPulling="2026-06-02 17:07:27.058721783 +0000 UTC m=+521.177684377" observedRunningTime="2026-06-02 17:07:28.014181883 +0000 UTC m=+522.133144498" watchObservedRunningTime="2026-06-02 17:07:28.016893279 +0000 UTC m=+522.135855894" Jun 02 17:07:34.002226 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:34.002196 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-dd9m6" Jun 02 17:07:34.361860 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:34.361779 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:34.361860 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:34.361824 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:34.366446 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:34.366425 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:35.023363 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:35.023333 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76cbd4b6bd-7lc2r" Jun 02 17:07:35.066545 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:35.066511 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ccd48cd-9gpl9"] Jun 02 17:07:45.549152 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.549108 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5"] Jun 02 17:07:45.552185 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.552168 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.554975 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.554951 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 17:07:45.554975 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.554951 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pzlvq\"" Jun 02 17:07:45.556184 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.556163 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 17:07:45.560018 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.559994 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5"] Jun 02 17:07:45.581104 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.581082 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.581226 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.581149 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fqbt\" (UniqueName: \"kubernetes.io/projected/f60b78f9-3675-4961-acd7-542876030b17-kube-api-access-8fqbt\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.581226 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.581198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.682106 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.682064 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.682291 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.682118 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.682291 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.682169 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fqbt\" (UniqueName: \"kubernetes.io/projected/f60b78f9-3675-4961-acd7-542876030b17-kube-api-access-8fqbt\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.682515 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.682491 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.682609 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.682506 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.690358 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.690338 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fqbt\" (UniqueName: \"kubernetes.io/projected/f60b78f9-3675-4961-acd7-542876030b17-kube-api-access-8fqbt\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.861720 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.861617 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:45.991122 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:45.991088 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5"] Jun 02 17:07:45.993374 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:07:45.993341 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60b78f9_3675_4961_acd7_542876030b17.slice/crio-6db07fb7f52da39f35fd3c6c3301643b4ae7c52a6742b3d344d7c2e8c3dcafe5 WatchSource:0}: Error finding container 6db07fb7f52da39f35fd3c6c3301643b4ae7c52a6742b3d344d7c2e8c3dcafe5: Status 404 returned error can't find the container with id 6db07fb7f52da39f35fd3c6c3301643b4ae7c52a6742b3d344d7c2e8c3dcafe5 Jun 02 17:07:46.059865 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:46.059836 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" event={"ID":"f60b78f9-3675-4961-acd7-542876030b17","Type":"ContainerStarted","Data":"6db07fb7f52da39f35fd3c6c3301643b4ae7c52a6742b3d344d7c2e8c3dcafe5"} Jun 02 17:07:47.064933 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:47.064890 2561 generic.go:358] "Generic (PLEG): container finished" podID="f60b78f9-3675-4961-acd7-542876030b17" containerID="7d2a115da42b4b0138d83c44d1f0a2a0dfde772ae692756d39c7defb805abb8a" exitCode=0 Jun 02 17:07:47.065370 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:47.064952 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" event={"ID":"f60b78f9-3675-4961-acd7-542876030b17","Type":"ContainerDied","Data":"7d2a115da42b4b0138d83c44d1f0a2a0dfde772ae692756d39c7defb805abb8a"} Jun 02 17:07:50.077466 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:50.077413 2561 generic.go:358] "Generic (PLEG): container finished" podID="f60b78f9-3675-4961-acd7-542876030b17" containerID="cc85f6587d5751c02ac5b77de9b3963ae1fb06343334bfbd125b8456a3fdf6bd" exitCode=0 Jun 02 17:07:50.077856 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:50.077496 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" event={"ID":"f60b78f9-3675-4961-acd7-542876030b17","Type":"ContainerDied","Data":"cc85f6587d5751c02ac5b77de9b3963ae1fb06343334bfbd125b8456a3fdf6bd"} Jun 02 17:07:51.083134 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:51.083098 2561 generic.go:358] "Generic (PLEG): container finished" podID="f60b78f9-3675-4961-acd7-542876030b17" containerID="8364e34718cfb7d03fc7b5aed7034594ff091c362a57206f08870e2cf0729d65" exitCode=0 Jun 02 17:07:51.083527 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:51.083178 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" event={"ID":"f60b78f9-3675-4961-acd7-542876030b17","Type":"ContainerDied","Data":"8364e34718cfb7d03fc7b5aed7034594ff091c362a57206f08870e2cf0729d65"} Jun 02 17:07:52.211162 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:52.211137 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:52.234656 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:52.234628 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-util\") pod \"f60b78f9-3675-4961-acd7-542876030b17\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " Jun 02 17:07:52.234809 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:52.234687 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fqbt\" (UniqueName: \"kubernetes.io/projected/f60b78f9-3675-4961-acd7-542876030b17-kube-api-access-8fqbt\") pod \"f60b78f9-3675-4961-acd7-542876030b17\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " Jun 02 17:07:52.234809 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:52.234750 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-bundle\") pod \"f60b78f9-3675-4961-acd7-542876030b17\" (UID: \"f60b78f9-3675-4961-acd7-542876030b17\") " Jun 02 17:07:52.235194 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:52.235163 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-bundle" (OuterVolumeSpecName: "bundle") pod "f60b78f9-3675-4961-acd7-542876030b17" (UID: "f60b78f9-3675-4961-acd7-542876030b17"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 17:07:52.236818 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:52.236794 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f60b78f9-3675-4961-acd7-542876030b17-kube-api-access-8fqbt" (OuterVolumeSpecName: "kube-api-access-8fqbt") pod "f60b78f9-3675-4961-acd7-542876030b17" (UID: "f60b78f9-3675-4961-acd7-542876030b17"). InnerVolumeSpecName "kube-api-access-8fqbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:07:52.239397 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:52.239370 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-util" (OuterVolumeSpecName: "util") pod "f60b78f9-3675-4961-acd7-542876030b17" (UID: "f60b78f9-3675-4961-acd7-542876030b17"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 17:07:52.336389 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:52.336356 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-util\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:07:52.336389 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:52.336386 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fqbt\" (UniqueName: \"kubernetes.io/projected/f60b78f9-3675-4961-acd7-542876030b17-kube-api-access-8fqbt\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:07:52.336389 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:52.336397 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f60b78f9-3675-4961-acd7-542876030b17-bundle\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:07:53.093392 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:53.093360 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" event={"ID":"f60b78f9-3675-4961-acd7-542876030b17","Type":"ContainerDied","Data":"6db07fb7f52da39f35fd3c6c3301643b4ae7c52a6742b3d344d7c2e8c3dcafe5"} Jun 02 17:07:53.093392 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:53.093390 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78ehfdf5" Jun 02 17:07:53.093661 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:53.093395 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6db07fb7f52da39f35fd3c6c3301643b4ae7c52a6742b3d344d7c2e8c3dcafe5" Jun 02 17:07:58.143246 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.143204 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh"] Jun 02 17:07:58.143854 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.143658 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60b78f9-3675-4961-acd7-542876030b17" containerName="util" Jun 02 17:07:58.143854 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.143677 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60b78f9-3675-4961-acd7-542876030b17" containerName="util" Jun 02 17:07:58.143854 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.143698 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60b78f9-3675-4961-acd7-542876030b17" containerName="pull" Jun 02 17:07:58.143854 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.143705 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60b78f9-3675-4961-acd7-542876030b17" containerName="pull" Jun 02 17:07:58.143854 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.143716 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60b78f9-3675-4961-acd7-542876030b17" containerName="extract" Jun 02 17:07:58.143854 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.143724 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60b78f9-3675-4961-acd7-542876030b17" containerName="extract" Jun 02 17:07:58.143854 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.143831 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="f60b78f9-3675-4961-acd7-542876030b17" containerName="extract" Jun 02 17:07:58.146767 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.146747 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" Jun 02 17:07:58.149322 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.149298 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 02 17:07:58.150682 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.150540 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-p8j6b\"" Jun 02 17:07:58.150682 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.150562 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 02 17:07:58.152910 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.152889 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh"] Jun 02 17:07:58.183685 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.183660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl9p4\" (UniqueName: \"kubernetes.io/projected/7442c8fa-ecd5-48a8-a588-4363820f058f-kube-api-access-tl9p4\") pod \"jobset-operator-747c5859c7-h7pxh\" (UID: \"7442c8fa-ecd5-48a8-a588-4363820f058f\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" Jun 02 17:07:58.183788 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.183742 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7442c8fa-ecd5-48a8-a588-4363820f058f-tmp\") pod \"jobset-operator-747c5859c7-h7pxh\" (UID: \"7442c8fa-ecd5-48a8-a588-4363820f058f\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" Jun 02 17:07:58.284760 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.284719 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7442c8fa-ecd5-48a8-a588-4363820f058f-tmp\") pod \"jobset-operator-747c5859c7-h7pxh\" (UID: \"7442c8fa-ecd5-48a8-a588-4363820f058f\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" Jun 02 17:07:58.284930 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.284780 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9p4\" (UniqueName: \"kubernetes.io/projected/7442c8fa-ecd5-48a8-a588-4363820f058f-kube-api-access-tl9p4\") pod \"jobset-operator-747c5859c7-h7pxh\" (UID: \"7442c8fa-ecd5-48a8-a588-4363820f058f\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" Jun 02 17:07:58.285128 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.285110 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7442c8fa-ecd5-48a8-a588-4363820f058f-tmp\") pod \"jobset-operator-747c5859c7-h7pxh\" (UID: \"7442c8fa-ecd5-48a8-a588-4363820f058f\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" Jun 02 17:07:58.293908 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.293882 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl9p4\" (UniqueName: \"kubernetes.io/projected/7442c8fa-ecd5-48a8-a588-4363820f058f-kube-api-access-tl9p4\") pod \"jobset-operator-747c5859c7-h7pxh\" (UID: \"7442c8fa-ecd5-48a8-a588-4363820f058f\") " pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" Jun 02 17:07:58.456600 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.456545 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" Jun 02 17:07:58.583358 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:58.583332 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh"] Jun 02 17:07:58.585472 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:07:58.585433 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7442c8fa_ecd5_48a8_a588_4363820f058f.slice/crio-9b568004559b4333c8bb49c633771fc8129c733248ba630618a259a756fe3f14 WatchSource:0}: Error finding container 9b568004559b4333c8bb49c633771fc8129c733248ba630618a259a756fe3f14: Status 404 returned error can't find the container with id 9b568004559b4333c8bb49c633771fc8129c733248ba630618a259a756fe3f14 Jun 02 17:07:59.112203 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:07:59.112163 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" event={"ID":"7442c8fa-ecd5-48a8-a588-4363820f058f","Type":"ContainerStarted","Data":"9b568004559b4333c8bb49c633771fc8129c733248ba630618a259a756fe3f14"} Jun 02 17:08:00.093634 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.093563 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5ccd48cd-9gpl9" podUID="69ff07e6-8967-4bba-919c-1604b95e0b23" containerName="console" containerID="cri-o://621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b" gracePeriod=15 Jun 02 17:08:00.336885 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.336859 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5ccd48cd-9gpl9_69ff07e6-8967-4bba-919c-1604b95e0b23/console/0.log" Jun 02 17:08:00.336997 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.336921 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:08:00.402593 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.402489 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-oauth-config\") pod \"69ff07e6-8967-4bba-919c-1604b95e0b23\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " Jun 02 17:08:00.402593 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.402543 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-console-config\") pod \"69ff07e6-8967-4bba-919c-1604b95e0b23\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " Jun 02 17:08:00.402593 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.402592 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-serving-cert\") pod \"69ff07e6-8967-4bba-919c-1604b95e0b23\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " Jun 02 17:08:00.403072 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.402626 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-oauth-serving-cert\") pod \"69ff07e6-8967-4bba-919c-1604b95e0b23\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " Jun 02 17:08:00.403072 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.402727 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc4tm\" (UniqueName: \"kubernetes.io/projected/69ff07e6-8967-4bba-919c-1604b95e0b23-kube-api-access-fc4tm\") pod \"69ff07e6-8967-4bba-919c-1604b95e0b23\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " Jun 02 17:08:00.403072 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.402810 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-service-ca\") pod \"69ff07e6-8967-4bba-919c-1604b95e0b23\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " Jun 02 17:08:00.403072 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.402972 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-trusted-ca-bundle\") pod \"69ff07e6-8967-4bba-919c-1604b95e0b23\" (UID: \"69ff07e6-8967-4bba-919c-1604b95e0b23\") " Jun 02 17:08:00.403278 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.403165 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-console-config" (OuterVolumeSpecName: "console-config") pod "69ff07e6-8967-4bba-919c-1604b95e0b23" (UID: "69ff07e6-8967-4bba-919c-1604b95e0b23"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:08:00.403367 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.403346 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-console-config\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:08:00.403519 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.403482 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "69ff07e6-8967-4bba-919c-1604b95e0b23" (UID: "69ff07e6-8967-4bba-919c-1604b95e0b23"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:08:00.403631 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.403523 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "69ff07e6-8967-4bba-919c-1604b95e0b23" (UID: "69ff07e6-8967-4bba-919c-1604b95e0b23"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:08:00.403736 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.403712 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-service-ca" (OuterVolumeSpecName: "service-ca") pod "69ff07e6-8967-4bba-919c-1604b95e0b23" (UID: "69ff07e6-8967-4bba-919c-1604b95e0b23"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 17:08:00.405349 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.405325 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "69ff07e6-8967-4bba-919c-1604b95e0b23" (UID: "69ff07e6-8967-4bba-919c-1604b95e0b23"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:08:00.405456 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.405419 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "69ff07e6-8967-4bba-919c-1604b95e0b23" (UID: "69ff07e6-8967-4bba-919c-1604b95e0b23"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 17:08:00.405502 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.405477 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69ff07e6-8967-4bba-919c-1604b95e0b23-kube-api-access-fc4tm" (OuterVolumeSpecName: "kube-api-access-fc4tm") pod "69ff07e6-8967-4bba-919c-1604b95e0b23" (UID: "69ff07e6-8967-4bba-919c-1604b95e0b23"). InnerVolumeSpecName "kube-api-access-fc4tm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:08:00.504991 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.504956 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc4tm\" (UniqueName: \"kubernetes.io/projected/69ff07e6-8967-4bba-919c-1604b95e0b23-kube-api-access-fc4tm\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:08:00.504991 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.504987 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-service-ca\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:08:00.504991 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.504998 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-trusted-ca-bundle\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:08:00.505470 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.505008 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-oauth-config\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:08:00.505470 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.505017 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69ff07e6-8967-4bba-919c-1604b95e0b23-console-serving-cert\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:08:00.505470 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:00.505025 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69ff07e6-8967-4bba-919c-1604b95e0b23-oauth-serving-cert\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:08:01.120798 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:01.120772 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5ccd48cd-9gpl9_69ff07e6-8967-4bba-919c-1604b95e0b23/console/0.log" Jun 02 17:08:01.121268 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:01.120811 2561 generic.go:358] "Generic (PLEG): container finished" podID="69ff07e6-8967-4bba-919c-1604b95e0b23" containerID="621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b" exitCode=2 Jun 02 17:08:01.121268 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:01.120874 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccd48cd-9gpl9" event={"ID":"69ff07e6-8967-4bba-919c-1604b95e0b23","Type":"ContainerDied","Data":"621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b"} Jun 02 17:08:01.121268 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:01.120889 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccd48cd-9gpl9" Jun 02 17:08:01.121268 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:01.120899 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccd48cd-9gpl9" event={"ID":"69ff07e6-8967-4bba-919c-1604b95e0b23","Type":"ContainerDied","Data":"7076b9495f021b7e16635878c180c9c0dafd18f4a2daee70f5a6139b08f63dac"} Jun 02 17:08:01.121268 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:01.120914 2561 scope.go:117] "RemoveContainer" containerID="621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b" Jun 02 17:08:01.141910 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:01.141874 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ccd48cd-9gpl9"] Jun 02 17:08:01.145161 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:01.145136 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ccd48cd-9gpl9"] Jun 02 17:08:01.336314 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:01.336287 2561 scope.go:117] "RemoveContainer" containerID="621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b" Jun 02 17:08:01.336692 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:08:01.336665 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b\": container with ID starting with 621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b not found: ID does not exist" containerID="621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b" Jun 02 17:08:01.336761 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:01.336710 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b"} err="failed to get container status \"621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b\": rpc error: code = NotFound desc = could not find container \"621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b\": container with ID starting with 621f2fedc342564921f7b1befb304cc77cfc8325ed2f284e2a7c9d3262ffb03b not found: ID does not exist" Jun 02 17:08:02.124982 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:02.124937 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" event={"ID":"7442c8fa-ecd5-48a8-a588-4363820f058f","Type":"ContainerStarted","Data":"31c95855540d660644b83605604a92c6c5677bec690f68f2c2ad677e50927026"} Jun 02 17:08:02.140720 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:02.140652 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-747c5859c7-h7pxh" podStartSLOduration=1.328522668 podStartE2EDuration="4.140636736s" podCreationTimestamp="2026-06-02 17:07:58 +0000 UTC" firstStartedPulling="2026-06-02 17:07:58.587011047 +0000 UTC m=+552.705973644" lastFinishedPulling="2026-06-02 17:08:01.399125119 +0000 UTC m=+555.518087712" observedRunningTime="2026-06-02 17:08:02.139721421 +0000 UTC m=+556.258684037" watchObservedRunningTime="2026-06-02 17:08:02.140636736 +0000 UTC m=+556.259599350" Jun 02 17:08:02.405150 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:02.405075 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69ff07e6-8967-4bba-919c-1604b95e0b23" path="/var/lib/kubelet/pods/69ff07e6-8967-4bba-919c-1604b95e0b23/volumes" Jun 02 17:08:25.361871 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.361836 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4"] Jun 02 17:08:25.362320 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.362300 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69ff07e6-8967-4bba-919c-1604b95e0b23" containerName="console" Jun 02 17:08:25.362320 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.362319 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="69ff07e6-8967-4bba-919c-1604b95e0b23" containerName="console" Jun 02 17:08:25.362427 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.362388 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="69ff07e6-8967-4bba-919c-1604b95e0b23" containerName="console" Jun 02 17:08:25.369962 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.369942 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.376940 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.376914 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 02 17:08:25.376940 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.376925 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 17:08:25.377106 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.376968 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 02 17:08:25.378188 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.378163 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 17:08:25.378278 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.378255 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-95n95\"" Jun 02 17:08:25.380365 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.380345 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4"] Jun 02 17:08:25.514965 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.514934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sscxz\" (UniqueName: \"kubernetes.io/projected/946a84f6-baa2-470e-a753-5e82e6e9cadb-kube-api-access-sscxz\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-znmp4\" (UID: \"946a84f6-baa2-470e-a753-5e82e6e9cadb\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.515103 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.515018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/946a84f6-baa2-470e-a753-5e82e6e9cadb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-znmp4\" (UID: \"946a84f6-baa2-470e-a753-5e82e6e9cadb\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.515103 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.515067 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/946a84f6-baa2-470e-a753-5e82e6e9cadb-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-znmp4\" (UID: \"946a84f6-baa2-470e-a753-5e82e6e9cadb\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.616389 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.616329 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/946a84f6-baa2-470e-a753-5e82e6e9cadb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-znmp4\" (UID: \"946a84f6-baa2-470e-a753-5e82e6e9cadb\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.616389 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.616368 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/946a84f6-baa2-470e-a753-5e82e6e9cadb-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-znmp4\" (UID: \"946a84f6-baa2-470e-a753-5e82e6e9cadb\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.616540 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.616389 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sscxz\" (UniqueName: \"kubernetes.io/projected/946a84f6-baa2-470e-a753-5e82e6e9cadb-kube-api-access-sscxz\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-znmp4\" (UID: \"946a84f6-baa2-470e-a753-5e82e6e9cadb\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.616935 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.616913 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/946a84f6-baa2-470e-a753-5e82e6e9cadb-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-znmp4\" (UID: \"946a84f6-baa2-470e-a753-5e82e6e9cadb\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.618652 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.618627 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/946a84f6-baa2-470e-a753-5e82e6e9cadb-cert\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-znmp4\" (UID: \"946a84f6-baa2-470e-a753-5e82e6e9cadb\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.624070 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.624052 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sscxz\" (UniqueName: \"kubernetes.io/projected/946a84f6-baa2-470e-a753-5e82e6e9cadb-kube-api-access-sscxz\") pod \"kubeflow-trainer-controller-manager-57cfc69d8d-znmp4\" (UID: \"946a84f6-baa2-470e-a753-5e82e6e9cadb\") " pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.678528 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.678504 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:25.804451 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:25.804426 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4"] Jun 02 17:08:25.806983 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:08:25.806956 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod946a84f6_baa2_470e_a753_5e82e6e9cadb.slice/crio-1a93884e8c384c68d5642618060b6cba3fca29e9c1f452376824809d86e27ec2 WatchSource:0}: Error finding container 1a93884e8c384c68d5642618060b6cba3fca29e9c1f452376824809d86e27ec2: Status 404 returned error can't find the container with id 1a93884e8c384c68d5642618060b6cba3fca29e9c1f452376824809d86e27ec2 Jun 02 17:08:26.202879 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:26.202847 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" event={"ID":"946a84f6-baa2-470e-a753-5e82e6e9cadb","Type":"ContainerStarted","Data":"1a93884e8c384c68d5642618060b6cba3fca29e9c1f452376824809d86e27ec2"} Jun 02 17:08:29.215406 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:29.215363 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" event={"ID":"946a84f6-baa2-470e-a753-5e82e6e9cadb","Type":"ContainerStarted","Data":"8693a57eb8d398944b3f29ceba29a9212e76b69510f6f9ccb594501a42435cf3"} Jun 02 17:08:29.215883 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:29.215440 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:29.234838 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:29.234789 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" podStartSLOduration=1.602166611 podStartE2EDuration="4.234775553s" podCreationTimestamp="2026-06-02 17:08:25 +0000 UTC" firstStartedPulling="2026-06-02 17:08:25.809126031 +0000 UTC m=+579.928088624" lastFinishedPulling="2026-06-02 17:08:28.441734972 +0000 UTC m=+582.560697566" observedRunningTime="2026-06-02 17:08:29.2324397 +0000 UTC m=+583.351402316" watchObservedRunningTime="2026-06-02 17:08:29.234775553 +0000 UTC m=+583.353738163" Jun 02 17:08:45.223074 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:45.223040 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-57cfc69d8d-znmp4" Jun 02 17:08:46.339864 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:46.339834 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/2.log" Jun 02 17:08:46.340244 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:46.339834 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/2.log" Jun 02 17:08:46.347504 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:46.347483 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 17:08:46.347684 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:08:46.347490 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 17:10:21.391160 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.391122 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8"] Jun 02 17:10:21.394333 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.394317 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" Jun 02 17:10:21.399214 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.399177 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-xc58r\"/\"openshift-service-ca.crt\"" Jun 02 17:10:21.399383 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.399368 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-xc58r\"/\"default-dockercfg-4htt8\"" Jun 02 17:10:21.400933 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.400483 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-xc58r\"/\"kube-root-ca.crt\"" Jun 02 17:10:21.419446 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.419425 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8"] Jun 02 17:10:21.459012 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.458976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9wm2\" (UniqueName: \"kubernetes.io/projected/c1017a44-fbd7-416f-8a6e-3e859311f5f9-kube-api-access-q9wm2\") pod \"test-trainjob-tt8kz-node-0-0-lrgm8\" (UID: \"c1017a44-fbd7-416f-8a6e-3e859311f5f9\") " pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" Jun 02 17:10:21.559851 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.559805 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9wm2\" (UniqueName: \"kubernetes.io/projected/c1017a44-fbd7-416f-8a6e-3e859311f5f9-kube-api-access-q9wm2\") pod \"test-trainjob-tt8kz-node-0-0-lrgm8\" (UID: \"c1017a44-fbd7-416f-8a6e-3e859311f5f9\") " pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" Jun 02 17:10:21.570683 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.570653 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9wm2\" (UniqueName: \"kubernetes.io/projected/c1017a44-fbd7-416f-8a6e-3e859311f5f9-kube-api-access-q9wm2\") pod \"test-trainjob-tt8kz-node-0-0-lrgm8\" (UID: \"c1017a44-fbd7-416f-8a6e-3e859311f5f9\") " pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" Jun 02 17:10:21.703898 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.703810 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" Jun 02 17:10:21.854662 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:10:21.854627 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1017a44_fbd7_416f_8a6e_3e859311f5f9.slice/crio-99bbc0c39e6a400b88173f72a75e230bcdcc96b74ece43b661c75fe9fa6c2e80 WatchSource:0}: Error finding container 99bbc0c39e6a400b88173f72a75e230bcdcc96b74ece43b661c75fe9fa6c2e80: Status 404 returned error can't find the container with id 99bbc0c39e6a400b88173f72a75e230bcdcc96b74ece43b661c75fe9fa6c2e80 Jun 02 17:10:21.855822 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:21.855798 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8"] Jun 02 17:10:22.591434 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:10:22.591364 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" event={"ID":"c1017a44-fbd7-416f-8a6e-3e859311f5f9","Type":"ContainerStarted","Data":"99bbc0c39e6a400b88173f72a75e230bcdcc96b74ece43b661c75fe9fa6c2e80"} Jun 02 17:14:36.287124 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:36.287092 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/2.log" Jun 02 17:14:36.330259 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:36.287095 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/2.log" Jun 02 17:14:36.330259 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:36.307839 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 17:14:36.330259 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:36.307846 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 17:14:37.538913 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:37.538828 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" event={"ID":"c1017a44-fbd7-416f-8a6e-3e859311f5f9","Type":"ContainerStarted","Data":"35dc9873b22dd46f6236c255fedef5e2483ce53472e11b70a77cd02d6d494386"} Jun 02 17:14:37.565845 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:37.565793 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" podStartSLOduration=1.180714099 podStartE2EDuration="4m16.565779966s" podCreationTimestamp="2026-06-02 17:10:21 +0000 UTC" firstStartedPulling="2026-06-02 17:10:21.856692793 +0000 UTC m=+695.975655389" lastFinishedPulling="2026-06-02 17:14:37.24175866 +0000 UTC m=+951.360721256" observedRunningTime="2026-06-02 17:14:37.563215336 +0000 UTC m=+951.682177950" watchObservedRunningTime="2026-06-02 17:14:37.565779966 +0000 UTC m=+951.684742580" Jun 02 17:14:38.888467 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:38.888439 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-xc58r_test-trainjob-tt8kz-node-0-0-lrgm8_c1017a44-fbd7-416f-8a6e-3e859311f5f9/node/0.log" Jun 02 17:14:41.887514 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:41.887479 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-xc58r_test-trainjob-tt8kz-node-0-0-lrgm8_c1017a44-fbd7-416f-8a6e-3e859311f5f9/node/0.log" Jun 02 17:14:44.564181 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:44.564145 2561 generic.go:358] "Generic (PLEG): container finished" podID="c1017a44-fbd7-416f-8a6e-3e859311f5f9" containerID="35dc9873b22dd46f6236c255fedef5e2483ce53472e11b70a77cd02d6d494386" exitCode=0 Jun 02 17:14:44.564533 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:44.564219 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" event={"ID":"c1017a44-fbd7-416f-8a6e-3e859311f5f9","Type":"ContainerDied","Data":"35dc9873b22dd46f6236c255fedef5e2483ce53472e11b70a77cd02d6d494386"} Jun 02 17:14:44.888128 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:44.888046 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-xc58r_test-trainjob-tt8kz-node-0-0-lrgm8_c1017a44-fbd7-416f-8a6e-3e859311f5f9/node/0.log" Jun 02 17:14:45.702007 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:45.701983 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" Jun 02 17:14:45.862833 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:45.862752 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9wm2\" (UniqueName: \"kubernetes.io/projected/c1017a44-fbd7-416f-8a6e-3e859311f5f9-kube-api-access-q9wm2\") pod \"c1017a44-fbd7-416f-8a6e-3e859311f5f9\" (UID: \"c1017a44-fbd7-416f-8a6e-3e859311f5f9\") " Jun 02 17:14:45.864917 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:45.864889 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1017a44-fbd7-416f-8a6e-3e859311f5f9-kube-api-access-q9wm2" (OuterVolumeSpecName: "kube-api-access-q9wm2") pod "c1017a44-fbd7-416f-8a6e-3e859311f5f9" (UID: "c1017a44-fbd7-416f-8a6e-3e859311f5f9"). InnerVolumeSpecName "kube-api-access-q9wm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:14:45.964394 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:45.964366 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9wm2\" (UniqueName: \"kubernetes.io/projected/c1017a44-fbd7-416f-8a6e-3e859311f5f9-kube-api-access-q9wm2\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:14:46.577217 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:46.577188 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" Jun 02 17:14:46.577217 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:46.577202 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8" event={"ID":"c1017a44-fbd7-416f-8a6e-3e859311f5f9","Type":"ContainerDied","Data":"99bbc0c39e6a400b88173f72a75e230bcdcc96b74ece43b661c75fe9fa6c2e80"} Jun 02 17:14:46.577395 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:46.577232 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99bbc0c39e6a400b88173f72a75e230bcdcc96b74ece43b661c75fe9fa6c2e80" Jun 02 17:14:47.249436 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:47.249398 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-xc58r_test-trainjob-tt8kz-node-0-0-lrgm8_c1017a44-fbd7-416f-8a6e-3e859311f5f9/node/0.log" Jun 02 17:14:48.742247 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:48.742217 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8btdv/must-gather-5psdw"] Jun 02 17:14:48.742687 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:48.742519 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1017a44-fbd7-416f-8a6e-3e859311f5f9" containerName="node" Jun 02 17:14:48.742687 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:48.742530 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1017a44-fbd7-416f-8a6e-3e859311f5f9" containerName="node" Jun 02 17:14:48.742687 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:48.742600 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1017a44-fbd7-416f-8a6e-3e859311f5f9" containerName="node" Jun 02 17:14:49.080614 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.080518 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8btdv/must-gather-5psdw"] Jun 02 17:14:49.080761 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.080644 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8btdv/must-gather-5psdw" Jun 02 17:14:49.083790 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.083765 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8btdv\"/\"kube-root-ca.crt\"" Jun 02 17:14:49.085090 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.085052 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8btdv\"/\"openshift-service-ca.crt\"" Jun 02 17:14:49.085090 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.085058 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8btdv\"/\"default-dockercfg-27plb\"" Jun 02 17:14:49.192986 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.192958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggwnf\" (UniqueName: \"kubernetes.io/projected/73c71ce6-daba-4da9-a9c6-e9340268e2e6-kube-api-access-ggwnf\") pod \"must-gather-5psdw\" (UID: \"73c71ce6-daba-4da9-a9c6-e9340268e2e6\") " pod="openshift-must-gather-8btdv/must-gather-5psdw" Jun 02 17:14:49.193134 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.193003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/73c71ce6-daba-4da9-a9c6-e9340268e2e6-must-gather-output\") pod \"must-gather-5psdw\" (UID: \"73c71ce6-daba-4da9-a9c6-e9340268e2e6\") " pod="openshift-must-gather-8btdv/must-gather-5psdw" Jun 02 17:14:49.294326 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.294295 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggwnf\" (UniqueName: \"kubernetes.io/projected/73c71ce6-daba-4da9-a9c6-e9340268e2e6-kube-api-access-ggwnf\") pod \"must-gather-5psdw\" (UID: \"73c71ce6-daba-4da9-a9c6-e9340268e2e6\") " pod="openshift-must-gather-8btdv/must-gather-5psdw" Jun 02 17:14:49.294453 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.294341 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/73c71ce6-daba-4da9-a9c6-e9340268e2e6-must-gather-output\") pod \"must-gather-5psdw\" (UID: \"73c71ce6-daba-4da9-a9c6-e9340268e2e6\") " pod="openshift-must-gather-8btdv/must-gather-5psdw" Jun 02 17:14:49.294788 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.294771 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/73c71ce6-daba-4da9-a9c6-e9340268e2e6-must-gather-output\") pod \"must-gather-5psdw\" (UID: \"73c71ce6-daba-4da9-a9c6-e9340268e2e6\") " pod="openshift-must-gather-8btdv/must-gather-5psdw" Jun 02 17:14:49.303102 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.303082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggwnf\" (UniqueName: \"kubernetes.io/projected/73c71ce6-daba-4da9-a9c6-e9340268e2e6-kube-api-access-ggwnf\") pod \"must-gather-5psdw\" (UID: \"73c71ce6-daba-4da9-a9c6-e9340268e2e6\") " pod="openshift-must-gather-8btdv/must-gather-5psdw" Jun 02 17:14:49.390337 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.390283 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8btdv/must-gather-5psdw" Jun 02 17:14:49.519323 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.519293 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8btdv/must-gather-5psdw"] Jun 02 17:14:49.521064 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:14:49.521035 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73c71ce6_daba_4da9_a9c6_e9340268e2e6.slice/crio-90b51b4f096152b0891aeb3dc5594537cc38bf877bf3787dc71af56073a0d158 WatchSource:0}: Error finding container 90b51b4f096152b0891aeb3dc5594537cc38bf877bf3787dc71af56073a0d158: Status 404 returned error can't find the container with id 90b51b4f096152b0891aeb3dc5594537cc38bf877bf3787dc71af56073a0d158 Jun 02 17:14:49.522819 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.522802 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 17:14:49.587313 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:49.587286 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8btdv/must-gather-5psdw" event={"ID":"73c71ce6-daba-4da9-a9c6-e9340268e2e6","Type":"ContainerStarted","Data":"90b51b4f096152b0891aeb3dc5594537cc38bf877bf3787dc71af56073a0d158"} Jun 02 17:14:52.280865 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:52.280830 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8"] Jun 02 17:14:52.284614 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:52.284587 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-xc58r/test-trainjob-tt8kz-node-0-0-lrgm8"] Jun 02 17:14:52.405806 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:52.405767 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1017a44-fbd7-416f-8a6e-3e859311f5f9" path="/var/lib/kubelet/pods/c1017a44-fbd7-416f-8a6e-3e859311f5f9/volumes" Jun 02 17:14:57.617800 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:57.617754 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8btdv/must-gather-5psdw" event={"ID":"73c71ce6-daba-4da9-a9c6-e9340268e2e6","Type":"ContainerStarted","Data":"fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9"} Jun 02 17:14:57.617800 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:14:57.617801 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8btdv/must-gather-5psdw" event={"ID":"73c71ce6-daba-4da9-a9c6-e9340268e2e6","Type":"ContainerStarted","Data":"fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a"} Jun 02 17:15:07.589678 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:07.589632 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-znmp4_946a84f6-baa2-470e-a753-5e82e6e9cadb/manager/0.log" Jun 02 17:15:08.075454 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:08.075423 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-znmp4_946a84f6-baa2-470e-a753-5e82e6e9cadb/manager/0.log" Jun 02 17:15:08.567165 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:08.567132 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-57cfc69d8d-znmp4_946a84f6-baa2-470e-a753-5e82e6e9cadb/manager/0.log" Jun 02 17:15:46.805565 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:46.805517 2561 generic.go:358] "Generic (PLEG): container finished" podID="73c71ce6-daba-4da9-a9c6-e9340268e2e6" containerID="fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a" exitCode=0 Jun 02 17:15:46.805995 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:46.805588 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8btdv/must-gather-5psdw" event={"ID":"73c71ce6-daba-4da9-a9c6-e9340268e2e6","Type":"ContainerDied","Data":"fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a"} Jun 02 17:15:46.805995 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:46.805928 2561 scope.go:117] "RemoveContainer" containerID="fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a" Jun 02 17:15:46.846497 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:46.846467 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8btdv_must-gather-5psdw_73c71ce6-daba-4da9-a9c6-e9340268e2e6/gather/0.log" Jun 02 17:15:49.917504 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:49.917469 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5tvm7_c5b03c69-df2f-48d0-8669-cb3431fe80b5/global-pull-secret-syncer/0.log" Jun 02 17:15:50.285073 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:50.285043 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zm6n5_52f1d8f1-e0fd-49a9-9949-2fcbdde90afd/konnectivity-agent/0.log" Jun 02 17:15:50.380706 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:50.380680 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-118.ec2.internal_44685aa4636debb2744cfaa33e22af42/haproxy/0.log" Jun 02 17:15:52.195112 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.195076 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-8btdv/must-gather-5psdw"] Jun 02 17:15:52.195481 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.195311 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-8btdv/must-gather-5psdw" podUID="73c71ce6-daba-4da9-a9c6-e9340268e2e6" containerName="copy" containerID="cri-o://fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9" gracePeriod=2 Jun 02 17:15:52.202106 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.202077 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-8btdv/must-gather-5psdw"] Jun 02 17:15:52.424742 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.424717 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8btdv_must-gather-5psdw_73c71ce6-daba-4da9-a9c6-e9340268e2e6/copy/0.log" Jun 02 17:15:52.425048 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.425034 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8btdv/must-gather-5psdw" Jun 02 17:15:52.548294 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.548271 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/73c71ce6-daba-4da9-a9c6-e9340268e2e6-must-gather-output\") pod \"73c71ce6-daba-4da9-a9c6-e9340268e2e6\" (UID: \"73c71ce6-daba-4da9-a9c6-e9340268e2e6\") " Jun 02 17:15:52.548445 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.548384 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggwnf\" (UniqueName: \"kubernetes.io/projected/73c71ce6-daba-4da9-a9c6-e9340268e2e6-kube-api-access-ggwnf\") pod \"73c71ce6-daba-4da9-a9c6-e9340268e2e6\" (UID: \"73c71ce6-daba-4da9-a9c6-e9340268e2e6\") " Jun 02 17:15:52.550450 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.550424 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73c71ce6-daba-4da9-a9c6-e9340268e2e6-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "73c71ce6-daba-4da9-a9c6-e9340268e2e6" (UID: "73c71ce6-daba-4da9-a9c6-e9340268e2e6"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 17:15:52.550583 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.550466 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73c71ce6-daba-4da9-a9c6-e9340268e2e6-kube-api-access-ggwnf" (OuterVolumeSpecName: "kube-api-access-ggwnf") pod "73c71ce6-daba-4da9-a9c6-e9340268e2e6" (UID: "73c71ce6-daba-4da9-a9c6-e9340268e2e6"). InnerVolumeSpecName "kube-api-access-ggwnf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 17:15:52.649282 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.649258 2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/73c71ce6-daba-4da9-a9c6-e9340268e2e6-must-gather-output\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:15:52.649282 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.649281 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggwnf\" (UniqueName: \"kubernetes.io/projected/73c71ce6-daba-4da9-a9c6-e9340268e2e6-kube-api-access-ggwnf\") on node \"ip-10-0-143-118.ec2.internal\" DevicePath \"\"" Jun 02 17:15:52.826424 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.826350 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-8btdv_must-gather-5psdw_73c71ce6-daba-4da9-a9c6-e9340268e2e6/copy/0.log" Jun 02 17:15:52.826708 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.826685 2561 generic.go:358] "Generic (PLEG): container finished" podID="73c71ce6-daba-4da9-a9c6-e9340268e2e6" containerID="fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9" exitCode=143 Jun 02 17:15:52.826795 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.826729 2561 scope.go:117] "RemoveContainer" containerID="fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9" Jun 02 17:15:52.826795 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.826748 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8btdv/must-gather-5psdw" Jun 02 17:15:52.834290 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.834182 2561 scope.go:117] "RemoveContainer" containerID="fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a" Jun 02 17:15:52.844934 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.844914 2561 scope.go:117] "RemoveContainer" containerID="fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9" Jun 02 17:15:52.845179 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:15:52.845160 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9\": container with ID starting with fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9 not found: ID does not exist" containerID="fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9" Jun 02 17:15:52.845222 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.845187 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9"} err="failed to get container status \"fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9\": rpc error: code = NotFound desc = could not find container \"fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9\": container with ID starting with fd90fd7b0a23ca8ec8eeb3b62cb8717ed3dcbb6e4e1cb925cf40e9d94ac3aea9 not found: ID does not exist" Jun 02 17:15:52.845222 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.845205 2561 scope.go:117] "RemoveContainer" containerID="fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a" Jun 02 17:15:52.845430 ip-10-0-143-118 kubenswrapper[2561]: E0602 17:15:52.845396 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a\": container with ID starting with fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a not found: ID does not exist" containerID="fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a" Jun 02 17:15:52.845534 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:52.845453 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a"} err="failed to get container status \"fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a\": rpc error: code = NotFound desc = could not find container \"fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a\": container with ID starting with fd8e626bd0ffffcc5a1f449b2f5701dbfb01c694ac1d30427dbbc5dc6ff91c4a not found: ID does not exist" Jun 02 17:15:53.157737 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.157660 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8911916-081f-4607-b334-c6995cdf80b8/alertmanager/0.log" Jun 02 17:15:53.184757 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.184731 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8911916-081f-4607-b334-c6995cdf80b8/config-reloader/0.log" Jun 02 17:15:53.206923 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.206901 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8911916-081f-4607-b334-c6995cdf80b8/kube-rbac-proxy-web/0.log" Jun 02 17:15:53.231342 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.231314 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8911916-081f-4607-b334-c6995cdf80b8/kube-rbac-proxy/0.log" Jun 02 17:15:53.254209 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.254189 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8911916-081f-4607-b334-c6995cdf80b8/kube-rbac-proxy-metric/0.log" Jun 02 17:15:53.276261 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.276242 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8911916-081f-4607-b334-c6995cdf80b8/prom-label-proxy/0.log" Jun 02 17:15:53.307837 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.307818 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d8911916-081f-4607-b334-c6995cdf80b8/init-config-reloader/0.log" Jun 02 17:15:53.355041 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.355011 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-4cxmg_9e02be24-e73f-4062-9f3d-d12e25f01d30/cluster-monitoring-operator/0.log" Jun 02 17:15:53.617608 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.617578 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-psd7n_643340d1-8d20-43bf-833b-fb7260b6c4c7/node-exporter/0.log" Jun 02 17:15:53.636965 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.636939 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-psd7n_643340d1-8d20-43bf-833b-fb7260b6c4c7/kube-rbac-proxy/0.log" Jun 02 17:15:53.657806 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:53.657786 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-psd7n_643340d1-8d20-43bf-833b-fb7260b6c4c7/init-textfile/0.log" Jun 02 17:15:54.124545 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:54.124511 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-559dffdb56-wj5vt_5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9/telemeter-client/0.log" Jun 02 17:15:54.147638 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:54.147616 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-559dffdb56-wj5vt_5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9/reload/0.log" Jun 02 17:15:54.171981 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:54.171959 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-559dffdb56-wj5vt_5c99fbb4-c1de-40bf-8e3a-cf90bf1082a9/kube-rbac-proxy/0.log" Jun 02 17:15:54.404532 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:54.404448 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73c71ce6-daba-4da9-a9c6-e9340268e2e6" path="/var/lib/kubelet/pods/73c71ce6-daba-4da9-a9c6-e9340268e2e6/volumes" Jun 02 17:15:55.946424 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:55.946339 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/2.log" Jun 02 17:15:55.953115 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:55.953094 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-5h7fn_d9e6780a-6384-4cdc-8c10-9380f591dd22/console-operator/3.log" Jun 02 17:15:56.341603 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.341567 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-76cbd4b6bd-7lc2r_86805d78-9421-4351-b336-72b5bc568c11/console/0.log" Jun 02 17:15:56.380789 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.380760 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-z46gs_436bcf83-7c6f-4794-9bba-cddc9d3c4f04/download-server/0.log" Jun 02 17:15:56.575144 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.575113 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm"] Jun 02 17:15:56.575414 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.575403 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73c71ce6-daba-4da9-a9c6-e9340268e2e6" containerName="copy" Jun 02 17:15:56.575464 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.575416 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="73c71ce6-daba-4da9-a9c6-e9340268e2e6" containerName="copy" Jun 02 17:15:56.575464 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.575437 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73c71ce6-daba-4da9-a9c6-e9340268e2e6" containerName="gather" Jun 02 17:15:56.575464 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.575442 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="73c71ce6-daba-4da9-a9c6-e9340268e2e6" containerName="gather" Jun 02 17:15:56.575581 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.575489 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="73c71ce6-daba-4da9-a9c6-e9340268e2e6" containerName="copy" Jun 02 17:15:56.575581 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.575498 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="73c71ce6-daba-4da9-a9c6-e9340268e2e6" containerName="gather" Jun 02 17:15:56.580356 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.580340 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.584034 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.584007 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n2ks8\"/\"default-dockercfg-wsn6k\"" Jun 02 17:15:56.585333 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.585313 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n2ks8\"/\"kube-root-ca.crt\"" Jun 02 17:15:56.585430 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.585318 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n2ks8\"/\"openshift-service-ca.crt\"" Jun 02 17:15:56.596364 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.596302 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm"] Jun 02 17:15:56.677950 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.677924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-sys\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.678134 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.677989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-podres\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.678134 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.678013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-proc\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.678134 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.678037 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-lib-modules\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.678134 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.678055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn6hv\" (UniqueName: \"kubernetes.io/projected/717403c9-3b3b-490a-9c49-d1ca47ff11ad-kube-api-access-wn6hv\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.778669 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.778642 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-podres\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.778828 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.778674 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-proc\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.778828 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.778701 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-lib-modules\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.778828 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.778724 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wn6hv\" (UniqueName: \"kubernetes.io/projected/717403c9-3b3b-490a-9c49-d1ca47ff11ad-kube-api-access-wn6hv\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.778828 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.778761 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-sys\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.778828 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.778772 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-proc\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.779005 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.778824 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-podres\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.779005 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.778832 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-sys\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.779005 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.778834 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/717403c9-3b3b-490a-9c49-d1ca47ff11ad-lib-modules\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.792180 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.792158 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn6hv\" (UniqueName: \"kubernetes.io/projected/717403c9-3b3b-490a-9c49-d1ca47ff11ad-kube-api-access-wn6hv\") pod \"perf-node-gather-daemonset-v9bjm\" (UID: \"717403c9-3b3b-490a-9c49-d1ca47ff11ad\") " pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:56.848957 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.848894 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-njz9w_bd2fcb5e-830d-4ee0-a735-b324dade245b/volume-data-source-validator/0.log" Jun 02 17:15:56.890177 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:56.890153 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:57.017819 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:57.017795 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm"] Jun 02 17:15:57.020311 ip-10-0-143-118 kubenswrapper[2561]: W0602 17:15:57.020282 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod717403c9_3b3b_490a_9c49_d1ca47ff11ad.slice/crio-97c484b148f263f349595d8af9c3d4d8d036062d19898153c0713f35f60c5fed WatchSource:0}: Error finding container 97c484b148f263f349595d8af9c3d4d8d036062d19898153c0713f35f60c5fed: Status 404 returned error can't find the container with id 97c484b148f263f349595d8af9c3d4d8d036062d19898153c0713f35f60c5fed Jun 02 17:15:57.590073 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:57.590044 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w4rwh_08960404-6b30-4974-a440-37b70c47fbe9/dns/0.log" Jun 02 17:15:57.611528 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:57.611502 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w4rwh_08960404-6b30-4974-a440-37b70c47fbe9/kube-rbac-proxy/0.log" Jun 02 17:15:57.635875 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:57.635846 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-c6kfb_8024b137-910f-4a08-8257-4ac1d69fcb73/dns-node-resolver/0.log" Jun 02 17:15:57.844507 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:57.844423 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" event={"ID":"717403c9-3b3b-490a-9c49-d1ca47ff11ad","Type":"ContainerStarted","Data":"00f647bdc7176c2c08386445e382904a17b3d53880c1fc21b6a6a2b9f51d3fb0"} Jun 02 17:15:57.844507 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:57.844462 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" event={"ID":"717403c9-3b3b-490a-9c49-d1ca47ff11ad","Type":"ContainerStarted","Data":"97c484b148f263f349595d8af9c3d4d8d036062d19898153c0713f35f60c5fed"} Jun 02 17:15:57.844696 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:57.844533 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:15:57.873289 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:57.873247 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" podStartSLOduration=1.873234655 podStartE2EDuration="1.873234655s" podCreationTimestamp="2026-06-02 17:15:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 17:15:57.870704211 +0000 UTC m=+1031.989666829" watchObservedRunningTime="2026-06-02 17:15:57.873234655 +0000 UTC m=+1031.992197323" Jun 02 17:15:58.145963 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:58.145885 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-796676d6bb-p6b6h_5341b370-8e16-4ed3-8de0-9c9f32dcea38/registry/0.log" Jun 02 17:15:58.219518 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:58.219488 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zhzh4_e80cafe8-be7a-42f7-8e54-49c1ce71acf1/node-ca/0.log" Jun 02 17:15:59.350744 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:59.350710 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jjcp4_c30e571f-e427-448b-a305-f0a1c032bbcc/serve-healthcheck-canary/0.log" Jun 02 17:15:59.783049 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:59.783022 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-wg6tm_17b93277-b713-4313-a736-79af364b1c86/insights-operator/1.log" Jun 02 17:15:59.783828 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:59.783803 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-wg6tm_17b93277-b713-4313-a736-79af364b1c86/insights-operator/0.log" Jun 02 17:15:59.973578 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:59.973529 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpsns_ef16754b-e9b2-4bd8-95e4-6a33a588af9e/kube-rbac-proxy/0.log" Jun 02 17:15:59.995329 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:15:59.995308 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpsns_ef16754b-e9b2-4bd8-95e4-6a33a588af9e/exporter/0.log" Jun 02 17:16:00.018214 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:00.018185 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qpsns_ef16754b-e9b2-4bd8-95e4-6a33a588af9e/extractor/0.log" Jun 02 17:16:01.640496 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:01.640465 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-747c5859c7-h7pxh_7442c8fa-ecd5-48a8-a588-4363820f058f/jobset-operator/0.log" Jun 02 17:16:03.858233 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:03.858199 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n2ks8/perf-node-gather-daemonset-v9bjm" Jun 02 17:16:05.333314 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:05.333287 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-5mxm7_7f53cb65-c3c4-423f-bfdd-0095e4877922/kube-storage-version-migrator-operator/1.log" Jun 02 17:16:05.335425 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:05.335400 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-5mxm7_7f53cb65-c3c4-423f-bfdd-0095e4877922/kube-storage-version-migrator-operator/0.log" Jun 02 17:16:06.353914 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:06.353877 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7kghr_4f44864d-0d36-470a-92f5-3b78deac4de3/kube-multus-additional-cni-plugins/0.log" Jun 02 17:16:06.380101 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:06.380021 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7kghr_4f44864d-0d36-470a-92f5-3b78deac4de3/egress-router-binary-copy/0.log" Jun 02 17:16:06.405422 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:06.405385 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7kghr_4f44864d-0d36-470a-92f5-3b78deac4de3/cni-plugins/0.log" Jun 02 17:16:06.425859 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:06.425832 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7kghr_4f44864d-0d36-470a-92f5-3b78deac4de3/bond-cni-plugin/0.log" Jun 02 17:16:06.446001 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:06.445973 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7kghr_4f44864d-0d36-470a-92f5-3b78deac4de3/routeoverride-cni/0.log" Jun 02 17:16:06.466958 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:06.466937 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7kghr_4f44864d-0d36-470a-92f5-3b78deac4de3/whereabouts-cni-bincopy/0.log" Jun 02 17:16:06.487382 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:06.487354 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7kghr_4f44864d-0d36-470a-92f5-3b78deac4de3/whereabouts-cni/0.log" Jun 02 17:16:06.840952 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:06.840920 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b5z9j_4cc1b71b-baa0-4914-8eac-a161b9d9e532/kube-multus/0.log" Jun 02 17:16:06.931971 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:06.931938 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dfg6z_e7d51764-e935-4acf-a016-44f761ffb245/network-metrics-daemon/0.log" Jun 02 17:16:06.950319 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:06.950289 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dfg6z_e7d51764-e935-4acf-a016-44f761ffb245/kube-rbac-proxy/0.log" Jun 02 17:16:08.321132 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:08.321099 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-controller/0.log" Jun 02 17:16:08.342373 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:08.342345 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/0.log" Jun 02 17:16:08.351605 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:08.351573 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovn-acl-logging/1.log" Jun 02 17:16:08.378134 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:08.378109 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/kube-rbac-proxy-node/0.log" Jun 02 17:16:08.407152 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:08.407130 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 17:16:08.429805 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:08.429776 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/northd/0.log" Jun 02 17:16:08.451918 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:08.451891 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/nbdb/0.log" Jun 02 17:16:08.475737 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:08.475701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/sbdb/0.log" Jun 02 17:16:08.630270 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:08.630183 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zx4vg_e536da72-ace0-487b-879d-126733038520/ovnkube-controller/0.log" Jun 02 17:16:09.612194 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:09.612168 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gxp86_022aefb6-b970-4da3-b9f8-0f93b1f3847e/network-check-target-container/0.log" Jun 02 17:16:10.498500 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:10.498466 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-cv4wj_38f08b8e-95da-4482-9d66-4ab9df185c0a/iptables-alerter/0.log" Jun 02 17:16:11.201343 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:11.201304 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-r4xx2_c0694ace-bb5f-4681-baef-9117404aa775/tuned/0.log" Jun 02 17:16:12.984445 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:12.984410 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-r62n7_2232283b-5c2c-4821-a988-c86c46a5beee/cluster-samples-operator/0.log" Jun 02 17:16:13.002886 ip-10-0-143-118 kubenswrapper[2561]: I0602 17:16:13.002863 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-r62n7_2232283b-5c2c-4821-a988-c86c46a5beee/cluster-samples-operator-watch/0.log"