Jun 11 21:27:36.717994 ip-10-0-129-177 systemd[1]: Starting Kubernetes Kubelet... Jun 11 21:27:37.176349 ip-10-0-129-177 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:27:37.176349 ip-10-0-129-177 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 21:27:37.176349 ip-10-0-129-177 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:27:37.176349 ip-10-0-129-177 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 21:27:37.176349 ip-10-0-129-177 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:27:37.178796 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.178695 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 21:27:37.183263 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183244 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:27:37.183263 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183264 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183268 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183272 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183275 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183278 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183281 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183284 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183287 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183290 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183292 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183295 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183298 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183301 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183304 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183306 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183315 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183317 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183320 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183323 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183326 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:27:37.183332 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183329 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183331 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183334 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183337 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183340 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183343 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183346 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183349 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183351 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183354 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183357 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183360 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183362 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183365 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183368 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183371 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183373 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183376 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183379 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183382 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:27:37.183825 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183384 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183387 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183389 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183392 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183394 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183397 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183399 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183402 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183404 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183407 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183409 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183412 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183414 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183417 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183422 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183426 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183430 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183434 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183437 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:27:37.184315 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183440 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183443 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183446 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183448 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183471 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183475 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183478 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183481 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183484 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183487 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183490 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183493 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183496 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183499 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183502 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183505 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183507 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183510 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183513 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183516 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:27:37.184799 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183518 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183522 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183526 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183528 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183531 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183533 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183536 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183541 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183544 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183547 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183550 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183552 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183555 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183557 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183560 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183563 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183565 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183568 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.183570 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184289 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:27:37.185296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184295 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184298 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184301 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184303 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184307 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184310 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184313 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184316 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184319 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184322 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184324 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184327 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184330 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184332 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184335 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184338 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184341 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184344 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184346 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184350 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:27:37.185798 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184355 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184359 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184363 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184366 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184369 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184372 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184374 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184377 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184380 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184382 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184385 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184388 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184390 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184393 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184395 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184398 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184400 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184404 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184406 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184409 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:27:37.186296 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184411 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184414 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184416 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184419 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184421 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184424 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184427 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184429 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184432 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184434 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184437 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184441 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184444 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184446 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184449 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184452 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184454 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184457 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184460 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184462 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:27:37.186816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184464 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184467 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184470 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184473 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184477 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184479 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184482 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184484 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184488 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184490 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184493 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184496 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184498 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184501 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184503 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184507 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184510 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184512 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184515 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184517 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:27:37.187321 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184520 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184523 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184525 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184528 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184531 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184535 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184538 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184541 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184544 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184546 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184549 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184552 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184554 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184557 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184559 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184563 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184567 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184570 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184977 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:27:37.187816 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184983 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184987 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184989 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184993 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184996 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.184999 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185002 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185006 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185010 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185013 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185015 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185019 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185022 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185024 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185027 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185030 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185033 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185035 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185038 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185040 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:27:37.188287 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185043 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185046 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185049 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185051 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185054 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185056 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185059 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185062 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185064 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185067 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185070 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185072 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185075 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185078 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185080 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185108 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185132 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185136 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185140 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:27:37.188832 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185144 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185150 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185154 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185158 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185162 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185167 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185176 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185183 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185187 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185191 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185194 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185197 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185201 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185204 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185207 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185210 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185213 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185216 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185219 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:27:37.189297 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185221 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185224 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185227 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185229 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185232 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185235 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185238 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185244 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185248 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185252 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185258 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185264 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185267 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185270 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185272 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185275 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185278 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185280 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185283 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185286 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:27:37.189796 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185290 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185293 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185296 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185298 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185301 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185304 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185307 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185310 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185313 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185315 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185318 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185320 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185324 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185328 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185332 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185336 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185340 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185343 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185346 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.185348 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185430 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 21:27:37.190372 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185439 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185448 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185453 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185458 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185461 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185466 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185471 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185474 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185477 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185482 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185488 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185493 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185498 2578 flags.go:64] FLAG: --cgroup-root="" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185503 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185507 2578 flags.go:64] FLAG: --client-ca-file="" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185511 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185514 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185518 2578 flags.go:64] FLAG: --cluster-domain="" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185521 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185524 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185527 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185531 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185535 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185539 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 21:27:37.190907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185542 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185545 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185548 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185551 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185554 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185557 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185561 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185565 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185568 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185572 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185575 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185579 2578 flags.go:64] FLAG: --enable-server="true" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185583 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185589 2578 flags.go:64] FLAG: --event-burst="100" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185593 2578 flags.go:64] FLAG: --event-qps="50" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185596 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185599 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185602 2578 flags.go:64] FLAG: --eviction-hard="" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185606 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185609 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185612 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185615 2578 flags.go:64] FLAG: --eviction-soft="" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185618 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185620 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185623 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 21:27:37.191475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185626 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185629 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185632 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185635 2578 flags.go:64] FLAG: --feature-gates="" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185639 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185642 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185658 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185662 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185666 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185669 2578 flags.go:64] FLAG: --help="false" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185672 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185675 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185678 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185682 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185685 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185689 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185696 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185699 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185702 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185705 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185716 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185719 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185722 2578 flags.go:64] FLAG: --kube-reserved="" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185725 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 21:27:37.192106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185728 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185731 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185734 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185738 2578 flags.go:64] FLAG: --lock-file="" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185741 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185744 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185747 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185753 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185756 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185759 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185762 2578 flags.go:64] FLAG: --logging-format="text" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185765 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185769 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185772 2578 flags.go:64] FLAG: --manifest-url="" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185775 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185780 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185783 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185788 2578 flags.go:64] FLAG: --max-pods="110" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185791 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185794 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185797 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185800 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185807 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185811 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185819 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 21:27:37.192748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185827 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185831 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185834 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185837 2578 flags.go:64] FLAG: --pod-cidr="" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185841 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185846 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185849 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185853 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185856 2578 flags.go:64] FLAG: --port="10250" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185860 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185862 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bc7c31be8bc2dff4" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185865 2578 flags.go:64] FLAG: --qos-reserved="" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185869 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185872 2578 flags.go:64] FLAG: --register-node="true" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185874 2578 flags.go:64] FLAG: --register-with-taints="" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185878 2578 flags.go:64] FLAG: --registry-burst="10" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185881 2578 flags.go:64] FLAG: --registry-qps="5" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185884 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185887 2578 flags.go:64] FLAG: --reserved-memory="" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185891 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185894 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185897 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185901 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185904 2578 flags.go:64] FLAG: --runonce="false" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185906 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 21:27:37.193364 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185909 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185912 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185915 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185918 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185921 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185926 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185930 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185933 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185936 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185939 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185942 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185945 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185948 2578 flags.go:64] FLAG: --system-cgroups="" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185951 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185957 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185960 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185963 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185967 2578 flags.go:64] FLAG: --tls-min-version="" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185970 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185972 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185975 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185978 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185981 2578 flags.go:64] FLAG: --v="2" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185988 2578 flags.go:64] FLAG: --version="false" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185992 2578 flags.go:64] FLAG: --vmodule="" Jun 11 21:27:37.194305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185995 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.185999 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186129 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186134 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186137 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186140 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186142 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186145 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186148 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186150 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186153 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186156 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186161 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186165 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186168 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186171 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186174 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186176 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186179 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186182 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:27:37.195145 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186185 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186188 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186191 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186193 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186196 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186198 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186201 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186204 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186206 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186209 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186211 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186214 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186218 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186222 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186225 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186228 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186231 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186234 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186237 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:27:37.195641 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186240 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186243 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186246 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186249 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186252 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186256 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186261 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186264 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186267 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186270 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186273 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186276 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186279 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186282 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186285 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186288 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186291 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186294 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186296 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186299 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:27:37.196137 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186301 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186304 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186307 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186310 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186312 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186315 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186318 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186321 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186323 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186326 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186328 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186332 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186334 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186338 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186340 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186343 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186345 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186349 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186353 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186356 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:27:37.196624 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186360 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186364 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186367 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186370 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186372 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186376 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186379 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186382 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186385 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186388 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186391 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186393 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186396 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186399 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186401 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186404 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186406 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186409 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186413 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186416 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:27:37.197139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186419 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.186421 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.187105 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.194590 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.194616 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.194663 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.194678 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.194838 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.194923 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.194951 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.194959 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.194965 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.194968 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.194972 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.194976 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:27:37.197619 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195002 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195008 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195139 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195145 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195150 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195154 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195158 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195160 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195163 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195168 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195170 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195173 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195176 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195179 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195182 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195185 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195187 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195192 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195196 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:27:37.198020 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195199 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195202 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195205 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195208 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195210 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195213 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195216 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195219 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195222 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195225 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195228 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195232 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195235 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195238 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195240 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195243 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195246 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195248 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195251 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195254 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:27:37.198496 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195257 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195260 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195262 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195265 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195268 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195271 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195273 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195276 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195279 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195281 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195284 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195287 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195289 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195292 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195295 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195297 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195300 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195303 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195306 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195309 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:27:37.198996 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195311 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195314 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195317 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195319 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195322 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195324 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195327 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195329 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195332 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195334 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195337 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195339 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195342 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195344 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195347 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195350 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195352 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195355 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195357 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195360 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:27:37.199486 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195362 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195365 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195368 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195370 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195373 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195376 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195378 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195380 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195383 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195386 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195389 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195392 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.195397 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195521 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195526 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:27:37.200032 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195529 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195532 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195534 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195537 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195540 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195542 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195545 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195548 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195550 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195553 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195556 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195559 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195561 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195564 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195566 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195569 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195571 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195574 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195576 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195579 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:27:37.200444 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195582 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195585 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195588 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195591 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195594 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195596 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195599 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195603 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195606 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195610 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195615 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195618 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195621 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195623 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195626 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195629 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195631 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195634 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195637 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195639 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:27:37.201103 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195642 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195661 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195664 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195666 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195669 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195672 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195675 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195678 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195681 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195684 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195686 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195689 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195692 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195695 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195698 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195700 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195703 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195705 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195708 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195711 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195714 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:27:37.201595 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195716 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195719 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195721 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195724 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195728 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195732 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195735 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195738 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195741 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195743 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195746 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195749 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195752 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195755 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195758 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195762 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195764 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195767 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195770 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:27:37.202130 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195772 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195775 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195777 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195780 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195783 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195786 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195788 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195791 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195794 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195797 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195800 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195802 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195805 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195808 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195811 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195813 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:27:37.202599 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:37.195816 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:27:37.203011 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.195821 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:27:37.203011 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.195951 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 21:27:37.203011 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.198475 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 21:27:37.203011 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.200694 2578 server.go:1019] "Starting client certificate rotation" Jun 11 21:27:37.203011 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.200794 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:27:37.203011 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.200823 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:27:37.203488 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.203475 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:27:37.207202 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.207181 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:27:37.217678 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.217659 2578 log.go:25] "Validated CRI v1 runtime API" Jun 11 21:27:37.222516 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.222500 2578 log.go:25] "Validated CRI v1 image API" Jun 11 21:27:37.224212 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.224197 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 21:27:37.226961 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.226936 2578 fs.go:135] Filesystem UUIDs: map[3bdcf130-76a8-4acb-b0d3-cc2199bdc8f6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b24290b5-3473-42da-ae47-868818dae295:/dev/nvme0n1p3] Jun 11 21:27:37.227105 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.226962 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 21:27:37.228294 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.228271 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:27:37.232234 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.232115 2578 manager.go:216] Machine: {Timestamp:2026-06-11 21:27:37.230802753 +0000 UTC m=+0.378743892 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099079 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b1bca3eba9a8ab79ac3ec8ae53dca SystemUUID:ec2b1bca-3eba-9a8a-b79a-c3ec8ae53dca BootID:378bcc3d-beff-48be-8066-366d50c93ae7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:9d:6d:35:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:9d:6d:35:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:df:fc:6a:c2:af Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 21:27:37.232234 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.232228 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 21:27:37.232386 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.232347 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 21:27:37.233593 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.233564 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 21:27:37.233744 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.233595 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 21:27:37.234370 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.234361 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 21:27:37.234408 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.234373 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 21:27:37.234408 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.234381 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:27:37.235017 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.235006 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:27:37.236452 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.236443 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 21:27:37.239658 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.239635 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:27:37.239959 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.239949 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 21:27:37.239995 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.239981 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 11 21:27:37.239995 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.239992 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 21:27:37.240059 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.240003 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 21:27:37.240059 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.240014 2578 kubelet.go:398] "Adding apiserver pod source" Jun 11 21:27:37.240059 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.240022 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 21:27:37.240534 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.240521 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:27:37.240567 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.240546 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:27:37.244564 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.244533 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 21:27:37.245977 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.245964 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 21:27:37.246042 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.245996 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 21:27:37.246160 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246149 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 21:27:37.246191 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246169 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 21:27:37.246191 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246175 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 21:27:37.246191 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246181 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 21:27:37.246191 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246189 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 21:27:37.246290 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246194 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 21:27:37.246739 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246728 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 21:27:37.246739 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246737 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 21:27:37.246868 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246745 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 21:27:37.246868 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246751 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 21:27:37.246868 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246759 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 21:27:37.246868 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.246767 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 21:27:37.247673 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.247662 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 21:27:37.247673 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.247673 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 21:27:37.250963 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.250951 2578 server.go:1268] "Started kubelet" Jun 11 21:27:37.251098 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.251037 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 21:27:37.251147 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.251123 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 21:27:37.251637 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.251596 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 21:27:37.251901 ip-10-0-129-177 systemd[1]: Started Kubernetes Kubelet. Jun 11 21:27:37.252932 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.252906 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 21:27:37.253696 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.253582 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 21:27:37.253696 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.253642 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 21:27:37.253696 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.253668 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 21:27:37.253696 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.253679 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 11 21:27:37.256225 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.256206 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mr5fl" Jun 11 21:27:37.256815 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.255587 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-177.ec2.internal.18b824052ba86c19 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-177.ec2.internal,UID:ip-10-0-129-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-177.ec2.internal,},FirstTimestamp:2026-06-11 21:27:37.250925593 +0000 UTC m=+0.398866752,LastTimestamp:2026-06-11 21:27:37.250925593 +0000 UTC m=+0.398866752,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-177.ec2.internal,}" Jun 11 21:27:37.257176 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.257162 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 21:27:37.257248 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.257176 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 21:27:37.257248 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.257234 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:37.257896 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.257878 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 21:27:37.258025 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258007 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 21:27:37.258025 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258024 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 21:27:37.258159 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258112 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 11 21:27:37.258159 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258121 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 11 21:27:37.258305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258287 2578 factory.go:55] Registering systemd factory Jun 11 21:27:37.258363 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258309 2578 factory.go:223] Registration of the systemd container factory successfully Jun 11 21:27:37.262467 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258733 2578 factory.go:153] Registering CRI-O factory Jun 11 21:27:37.262467 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258749 2578 factory.go:223] Registration of the crio container factory successfully Jun 11 21:27:37.262467 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258800 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 21:27:37.262467 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258824 2578 factory.go:103] Registering Raw factory Jun 11 21:27:37.262467 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.258838 2578 manager.go:1196] Started watching for new ooms in manager Jun 11 21:27:37.262467 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.259221 2578 manager.go:349] Starting recovery of all containers Jun 11 21:27:37.262467 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.262382 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 21:27:37.263743 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.263725 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mr5fl" Jun 11 21:27:37.270380 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.270197 2578 manager.go:354] Recovery completed Jun 11 21:27:37.271237 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.270193 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 21:27:37.271298 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.270337 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 21:27:37.275447 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.275432 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:27:37.277478 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.277462 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:27:37.277547 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.277490 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:27:37.277547 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.277500 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:27:37.278089 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.278062 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 21:27:37.278089 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.278076 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 21:27:37.278213 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.278094 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:27:37.278213 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.278094 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:27:37.278782 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.278763 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:27:37.278847 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.278793 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:27:37.278847 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.278803 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:27:37.279317 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.279307 2578 policy_none.go:49] "None policy: Start" Jun 11 21:27:37.279349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.279322 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 21:27:37.279349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.279332 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 21:27:37.280373 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.280363 2578 policy_none.go:47] "Start" Jun 11 21:27:37.314300 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.314279 2578 manager.go:337] "Starting Device Plugin manager" Jun 11 21:27:37.314403 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.314319 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 21:27:37.314403 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.314333 2578 server.go:87] "Starting device plugin registration server" Jun 11 21:27:37.314615 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.314604 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 21:27:37.314665 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.314621 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 21:27:37.314731 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.314712 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 21:27:37.314825 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.314805 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 21:27:37.314825 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.314819 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 21:27:37.315426 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.315404 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 21:27:37.315536 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.315461 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:37.332916 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.332879 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 21:27:37.337156 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.334231 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 21:27:37.337156 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.334276 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 21:27:37.337156 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.334296 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 21:27:37.337156 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.334335 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 21:27:37.337156 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.335858 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:27:37.415381 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.415333 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:27:37.416552 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.416535 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:27:37.416660 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.416566 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:27:37.416660 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.416575 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:27:37.416660 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.416601 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.423707 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.423691 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.423769 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.423715 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-177.ec2.internal\": node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:37.434675 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.434598 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal"] Jun 11 21:27:37.434675 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.434670 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:27:37.436598 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.436578 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:27:37.436712 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.436611 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:27:37.436712 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.436622 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:27:37.438085 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.438073 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:27:37.438242 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.438227 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.438302 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.438266 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:27:37.438868 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.438850 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:27:37.438963 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.438871 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:27:37.438963 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.438885 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:27:37.438963 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.438889 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:27:37.438963 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.438898 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:27:37.438963 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.438919 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:27:37.439398 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.439379 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:37.440034 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.440017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.440125 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.440051 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:27:37.440800 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.440786 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:27:37.440886 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.440808 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:27:37.440886 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.440817 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:27:37.467447 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.467418 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-177.ec2.internal\" not found" node="ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.472020 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.471999 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-177.ec2.internal\" not found" node="ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.540228 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.540193 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:37.558951 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.558917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c49f7a7525b890c85efe14ae9aca6d6-config\") pod \"kube-apiserver-proxy-ip-10-0-129-177.ec2.internal\" (UID: \"5c49f7a7525b890c85efe14ae9aca6d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.559067 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.558959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2e25a248d0719a18fd9dec0d31556fb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"c2e25a248d0719a18fd9dec0d31556fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.559067 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.558976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2e25a248d0719a18fd9dec0d31556fb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"c2e25a248d0719a18fd9dec0d31556fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.640526 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.640486 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:37.659872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.659842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c49f7a7525b890c85efe14ae9aca6d6-config\") pod \"kube-apiserver-proxy-ip-10-0-129-177.ec2.internal\" (UID: \"5c49f7a7525b890c85efe14ae9aca6d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.659964 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.659898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2e25a248d0719a18fd9dec0d31556fb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"c2e25a248d0719a18fd9dec0d31556fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.659964 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.659916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2e25a248d0719a18fd9dec0d31556fb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"c2e25a248d0719a18fd9dec0d31556fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.659964 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.659849 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c49f7a7525b890c85efe14ae9aca6d6-config\") pod \"kube-apiserver-proxy-ip-10-0-129-177.ec2.internal\" (UID: \"5c49f7a7525b890c85efe14ae9aca6d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.660081 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.659952 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c2e25a248d0719a18fd9dec0d31556fb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"c2e25a248d0719a18fd9dec0d31556fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.660081 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.659941 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c2e25a248d0719a18fd9dec0d31556fb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"c2e25a248d0719a18fd9dec0d31556fb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.741166 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.741095 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:37.769699 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.769636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.775581 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:37.775564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jun 11 21:27:37.841533 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.841485 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:37.942046 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:37.942018 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:38.042619 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:38.042533 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:38.079045 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.079012 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:27:38.143526 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:38.143489 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:38.200079 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.200049 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 21:27:38.200732 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.200196 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:27:38.200732 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.200211 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:27:38.243611 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:38.243575 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:38.269019 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.268980 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 21:22:37 +0000 UTC" deadline="2027-12-20 20:23:07.753840097 +0000 UTC" Jun 11 21:27:38.269019 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.269014 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13366h55m29.484829035s" Jun 11 21:27:38.278637 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:38.277802 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e25a248d0719a18fd9dec0d31556fb.slice/crio-4a6f5bd7ce4e19674e4eb21d273e24b5c458e04d208dfb3876a14559294e8590 WatchSource:0}: Error finding container 4a6f5bd7ce4e19674e4eb21d273e24b5c458e04d208dfb3876a14559294e8590: Status 404 returned error can't find the container with id 4a6f5bd7ce4e19674e4eb21d273e24b5c458e04d208dfb3876a14559294e8590 Jun 11 21:27:38.278637 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:38.278322 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c49f7a7525b890c85efe14ae9aca6d6.slice/crio-25a3fc59091a3a59605f90bba8780a9cef810b5b5a7c951736fbadbb57824a13 WatchSource:0}: Error finding container 25a3fc59091a3a59605f90bba8780a9cef810b5b5a7c951736fbadbb57824a13: Status 404 returned error can't find the container with id 25a3fc59091a3a59605f90bba8780a9cef810b5b5a7c951736fbadbb57824a13 Jun 11 21:27:38.284475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.284460 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:27:38.337678 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.337558 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" event={"ID":"5c49f7a7525b890c85efe14ae9aca6d6","Type":"ContainerStarted","Data":"25a3fc59091a3a59605f90bba8780a9cef810b5b5a7c951736fbadbb57824a13"} Jun 11 21:27:38.338670 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.338633 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" event={"ID":"c2e25a248d0719a18fd9dec0d31556fb","Type":"ContainerStarted","Data":"4a6f5bd7ce4e19674e4eb21d273e24b5c458e04d208dfb3876a14559294e8590"} Jun 11 21:27:38.343769 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:38.343743 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:38.444328 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:38.444288 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jun 11 21:27:38.477602 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.477579 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:27:38.558115 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.558087 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jun 11 21:27:38.569958 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.569932 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:27:38.571232 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.571214 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jun 11 21:27:38.581368 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.581347 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:27:38.819512 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:38.819417 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:27:39.240959 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.240855 2578 apiserver.go:52] "Watching apiserver" Jun 11 21:27:39.250799 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.250769 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 21:27:39.253687 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.253661 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-mnlz6","openshift-ovn-kubernetes/ovnkube-node-dfnmq","kube-system/global-pull-secret-syncer-b8b29","kube-system/konnectivity-agent-zjcsl","kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal","openshift-cluster-node-tuning-operator/tuned-b4gm9","openshift-dns/node-resolver-965jb","openshift-image-registry/node-ca-bsx4x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal","openshift-multus/multus-additional-cni-plugins-z7k92","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd","openshift-multus/multus-jpsm4","openshift-multus/network-metrics-daemon-4t9th","openshift-network-diagnostics/network-check-target-dqd6m"] Jun 11 21:27:39.255420 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.255397 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.256641 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.256615 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.257475 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.257460 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 21:27:39.258527 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.258481 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 21:27:39.258639 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.258543 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-czsc7\"" Jun 11 21:27:39.258639 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.258578 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 21:27:39.258792 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.258729 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:39.258846 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.258787 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:39.259578 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.259263 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 21:27:39.260154 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.259991 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 21:27:39.260154 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.260054 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-42pgr\"" Jun 11 21:27:39.260154 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.260068 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 21:27:39.260943 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.260682 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:27:39.262487 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.262463 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:39.262585 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.262554 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:39.263636 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.263531 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 21:27:39.263976 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.263946 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.264583 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.264419 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 21:27:39.264583 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.264495 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xg7mc\"" Jun 11 21:27:39.265860 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.265827 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.266490 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.266474 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mgdhx\"" Jun 11 21:27:39.266839 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.266820 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:27:39.266934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.266866 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 21:27:39.267084 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.267072 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:39.267137 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.267121 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:39.268302 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23-tmp-dir\") pod \"node-resolver-965jb\" (UID: \"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23\") " pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.268410 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wdfx\" (UniqueName: \"kubernetes.io/projected/a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23-kube-api-access-9wdfx\") pod \"node-resolver-965jb\" (UID: \"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23\") " pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.268410 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-socket-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.268410 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268380 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 21:27:39.268410 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.268666 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-sys-fs\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.268666 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.268666 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-registration-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.268666 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268539 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-device-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.268666 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268566 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38176311-61fa-4cea-9fbf-258415da1d0f-kubelet-config\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:39.268666 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xskr5\" (UniqueName: \"kubernetes.io/projected/972afe0f-4814-4604-8da4-69353be4c5b9-kube-api-access-xskr5\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.268666 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23-hosts-file\") pod \"node-resolver-965jb\" (UID: \"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23\") " pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.268666 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268630 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 21:27:39.268666 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38176311-61fa-4cea-9fbf-258415da1d0f-dbus\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:39.269129 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268672 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:39.269129 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268828 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fjhqd\"" Jun 11 21:27:39.269129 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268859 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.269129 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268910 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 21:27:39.269129 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.268950 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:27:39.270775 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.270736 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.271706 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.271686 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 21:27:39.271996 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.271959 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 21:27:39.271996 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.271978 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 21:27:39.272112 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.272007 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 21:27:39.272112 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.271981 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 21:27:39.272112 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.271964 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mmq9d\"" Jun 11 21:27:39.272599 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.272583 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.274989 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.274967 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 21:27:39.275211 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.275195 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 21:27:39.275288 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.275228 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.276276 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.275698 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 21:27:39.276276 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.275774 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 21:27:39.276276 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.275798 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 21:27:39.276276 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.275938 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:27:39.276276 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.276087 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2mbfd\"" Jun 11 21:27:39.276539 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.276338 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hl5b5\"" Jun 11 21:27:39.276539 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.276447 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 21:27:39.276618 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.276595 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 21:27:39.276677 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.276662 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 21:27:39.277688 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.277672 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 21:27:39.277883 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.277870 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v9zjh\"" Jun 11 21:27:39.293092 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.293070 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bcnfd" Jun 11 21:27:39.300772 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.300744 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bcnfd" Jun 11 21:27:39.359637 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.359614 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 21:27:39.369452 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-cni-netd\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.369603 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgg2\" (UniqueName: \"kubernetes.io/projected/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-kube-api-access-2sgg2\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.369603 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g2cn\" (UniqueName: \"kubernetes.io/projected/ba81491f-9a23-4ab5-9874-72a3829459d5-kube-api-access-6g2cn\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.369603 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-var-lib-cni-multus\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.369603 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-tmp\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.369603 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:39.369862 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.369862 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-lib-modules\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.369862 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-tuned\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.369862 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369711 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wdfx\" (UniqueName: \"kubernetes.io/projected/a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23-kube-api-access-9wdfx\") pod \"node-resolver-965jb\" (UID: \"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23\") " pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.369862 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-sys-fs\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.369862 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.369753 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:39.369862 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-node-log\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.369862 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-sys-fs\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.369862 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-cni-bin\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.369862 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f5bcfa1-3cac-42d5-8db7-0b547df270ca-iptables-alerter-script\") pod \"iptables-alerter-mnlz6\" (UID: \"6f5bcfa1-3cac-42d5-8db7-0b547df270ca\") " pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-os-release\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.369918 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret podName:38176311-61fa-4cea-9fbf-258415da1d0f nodeName:}" failed. No retries permitted until 2026-06-11 21:27:39.869895941 +0000 UTC m=+3.017837087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret") pod "global-pull-secret-syncer-b8b29" (UID: "38176311-61fa-4cea-9fbf-258415da1d0f") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10fc3aab-3208-41f0-abb4-40f376cb9cec-cni-binary-copy\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.369975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-run-netns\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-cni-dir\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370048 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370052 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbtbs\" (UniqueName: \"kubernetes.io/projected/10fc3aab-3208-41f0-abb4-40f376cb9cec-kube-api-access-hbtbs\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370079 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-sysctl-d\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-systemd\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-sys\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d06fa857-a932-4daf-b686-a0e47fbc56cc-host\") pod \"node-ca-bsx4x\" (UID: \"d06fa857-a932-4daf-b686-a0e47fbc56cc\") " pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xskr5\" (UniqueName: \"kubernetes.io/projected/972afe0f-4814-4604-8da4-69353be4c5b9-kube-api-access-xskr5\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-kubelet\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.370327 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370325 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-log-socket\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-os-release\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba81491f-9a23-4ab5-9874-72a3829459d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4bcc\" (UniqueName: \"kubernetes.io/projected/6f5bcfa1-3cac-42d5-8db7-0b547df270ca-kube-api-access-d4bcc\") pod \"iptables-alerter-mnlz6\" (UID: \"6f5bcfa1-3cac-42d5-8db7-0b547df270ca\") " pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-etc-kubernetes\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-run\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-run-ovn\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370540 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23-hosts-file\") pod \"node-resolver-965jb\" (UID: \"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23\") " pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370562 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38176311-61fa-4cea-9fbf-258415da1d0f-dbus\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-var-lib-openvswitch\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370625 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-cnibin\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-host\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370700 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23-hosts-file\") pod \"node-resolver-965jb\" (UID: \"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23\") " pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370742 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-ovnkube-config\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/38176311-61fa-4cea-9fbf-258415da1d0f-dbus\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-registration-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.371010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-device-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370844 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38176311-61fa-4cea-9fbf-258415da1d0f-kubelet-config\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370865 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-ovnkube-script-lib\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-cnibin\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370899 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-registration-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba81491f-9a23-4ab5-9874-72a3829459d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f5bcfa1-3cac-42d5-8db7-0b547df270ca-host-slash\") pod \"iptables-alerter-mnlz6\" (UID: \"6f5bcfa1-3cac-42d5-8db7-0b547df270ca\") " pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-system-cni-dir\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-device-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.370986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-etc-openvswitch\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/38176311-61fa-4cea-9fbf-258415da1d0f-kubelet-config\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371102 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-run-k8s-cni-cncf-io\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-conf-dir\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371177 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-var-lib-kubelet\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpftz\" (UniqueName: \"kubernetes.io/projected/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-kube-api-access-tpftz\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-slash\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.371938 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371284 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-run-systemd\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371308 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-env-overrides\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-hostroot\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-sysconfig\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-kubernetes\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371434 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23-tmp-dir\") pod \"node-resolver-965jb\" (UID: \"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23\") " pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-socket-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf7zp\" (UniqueName: \"kubernetes.io/projected/d06fa857-a932-4daf-b686-a0e47fbc56cc-kube-api-access-cf7zp\") pod \"node-ca-bsx4x\" (UID: \"d06fa857-a932-4daf-b686-a0e47fbc56cc\") " pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371514 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64nzd\" (UniqueName: \"kubernetes.io/projected/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-kube-api-access-64nzd\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-socket-dir-parent\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-run-multus-certs\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c0a27a5-7204-4798-998b-e1e2c1d199ed-agent-certs\") pod \"konnectivity-agent-zjcsl\" (UID: \"2c0a27a5-7204-4798-998b-e1e2c1d199ed\") " pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c0a27a5-7204-4798-998b-e1e2c1d199ed-konnectivity-ca\") pod \"konnectivity-agent-zjcsl\" (UID: \"2c0a27a5-7204-4798-998b-e1e2c1d199ed\") " pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371591 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-etc-selinux\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371602 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/972afe0f-4814-4604-8da4-69353be4c5b9-socket-dir\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.372577 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-sysctl-conf\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x98g\" (UniqueName: \"kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g\") pod \"network-check-target-dqd6m\" (UID: \"471957f3-589b-4e77-a9be-a4699944a36c\") " pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-run-openvswitch\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-var-lib-cni-bin\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371766 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-daemon-config\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371788 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d06fa857-a932-4daf-b686-a0e47fbc56cc-serviceca\") pod \"node-ca-bsx4x\" (UID: \"d06fa857-a932-4daf-b686-a0e47fbc56cc\") " pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-run-netns\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-ovn-node-metrics-cert\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba81491f-9a23-4ab5-9874-72a3829459d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371918 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23-tmp-dir\") pod \"node-resolver-965jb\" (UID: \"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23\") " pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371919 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371968 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-var-lib-kubelet\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.371999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-modprobe-d\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.372059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-system-cni-dir\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.373120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.372082 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-systemd-units\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.376492 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.376463 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 21:27:39.379992 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.379972 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wdfx\" (UniqueName: \"kubernetes.io/projected/a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23-kube-api-access-9wdfx\") pod \"node-resolver-965jb\" (UID: \"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23\") " pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.379992 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.379986 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xskr5\" (UniqueName: \"kubernetes.io/projected/972afe0f-4814-4604-8da4-69353be4c5b9-kube-api-access-xskr5\") pod \"aws-ebs-csi-driver-node-pgdfd\" (UID: \"972afe0f-4814-4604-8da4-69353be4c5b9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.472339 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-sysctl-conf\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.472339 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472339 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x98g\" (UniqueName: \"kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g\") pod \"network-check-target-dqd6m\" (UID: \"471957f3-589b-4e77-a9be-a4699944a36c\") " pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:39.472570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-run-openvswitch\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.472570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-var-lib-cni-bin\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.472570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472441 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-run-openvswitch\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.472570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472461 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-var-lib-cni-bin\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.472570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472438 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-daemon-config\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.472570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d06fa857-a932-4daf-b686-a0e47fbc56cc-serviceca\") pod \"node-ca-bsx4x\" (UID: \"d06fa857-a932-4daf-b686-a0e47fbc56cc\") " pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.472570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-run-netns\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.472570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472526 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-sysctl-conf\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.472570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-ovn-node-metrics-cert\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba81491f-9a23-4ab5-9874-72a3829459d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-run-netns\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-var-lib-kubelet\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-modprobe-d\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-system-cni-dir\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472750 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-systemd-units\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472755 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-var-lib-kubelet\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-cni-netd\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-system-cni-dir\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-cni-netd\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472814 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgg2\" (UniqueName: \"kubernetes.io/projected/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-kube-api-access-2sgg2\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472853 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-systemd-units\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-modprobe-d\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g2cn\" (UniqueName: \"kubernetes.io/projected/ba81491f-9a23-4ab5-9874-72a3829459d5-kube-api-access-6g2cn\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.472983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.472991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-var-lib-cni-multus\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473017 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-tmp\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473039 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d06fa857-a932-4daf-b686-a0e47fbc56cc-serviceca\") pod \"node-ca-bsx4x\" (UID: \"d06fa857-a932-4daf-b686-a0e47fbc56cc\") " pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-lib-modules\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-tuned\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-var-lib-cni-multus\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-node-log\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-cni-bin\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473200 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473232 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba81491f-9a23-4ab5-9874-72a3829459d5-cni-binary-copy\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473202 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f5bcfa1-3cac-42d5-8db7-0b547df270ca-iptables-alerter-script\") pod \"iptables-alerter-mnlz6\" (UID: \"6f5bcfa1-3cac-42d5-8db7-0b547df270ca\") " pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473266 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-node-log\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473270 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-lib-modules\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473292 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-os-release\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473309 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-cni-bin\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10fc3aab-3208-41f0-abb4-40f376cb9cec-cni-binary-copy\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-run-netns\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.473802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-os-release\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473373 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-cni-dir\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtbs\" (UniqueName: \"kubernetes.io/projected/10fc3aab-3208-41f0-abb4-40f376cb9cec-kube-api-access-hbtbs\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473435 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-cni-dir\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-sysctl-d\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-systemd\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-sys\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d06fa857-a932-4daf-b686-a0e47fbc56cc-host\") pod \"node-ca-bsx4x\" (UID: \"d06fa857-a932-4daf-b686-a0e47fbc56cc\") " pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473544 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-kubelet\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473548 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-sysctl-d\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-run-netns\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473592 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-kubelet\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-sys\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473690 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-systemd\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-log-socket\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f5bcfa1-3cac-42d5-8db7-0b547df270ca-iptables-alerter-script\") pod \"iptables-alerter-mnlz6\" (UID: \"6f5bcfa1-3cac-42d5-8db7-0b547df270ca\") " pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-log-socket\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473796 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d06fa857-a932-4daf-b686-a0e47fbc56cc-host\") pod \"node-ca-bsx4x\" (UID: \"d06fa857-a932-4daf-b686-a0e47fbc56cc\") " pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.474725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-os-release\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba81491f-9a23-4ab5-9874-72a3829459d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473927 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4bcc\" (UniqueName: \"kubernetes.io/projected/6f5bcfa1-3cac-42d5-8db7-0b547df270ca-kube-api-access-d4bcc\") pod \"iptables-alerter-mnlz6\" (UID: \"6f5bcfa1-3cac-42d5-8db7-0b547df270ca\") " pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473950 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-os-release\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-etc-kubernetes\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.473997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-run\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-run-ovn\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474069 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-var-lib-openvswitch\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474092 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-cnibin\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-host\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-run-ovn\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-ovnkube-config\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-var-lib-openvswitch\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474155 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-etc-kubernetes\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-run\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474214 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-ovnkube-script-lib\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474231 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-cnibin\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.475502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-cnibin\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.474247 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba81491f-9a23-4ab5-9874-72a3829459d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474275 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba81491f-9a23-4ab5-9874-72a3829459d5-cnibin\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.474311 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs podName:050b45ae-ece1-41ae-a59b-f8f81db2cf7e nodeName:}" failed. No retries permitted until 2026-06-11 21:27:39.974290433 +0000 UTC m=+3.122231575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs") pod "network-metrics-daemon-4t9th" (UID: "050b45ae-ece1-41ae-a59b-f8f81db2cf7e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f5bcfa1-3cac-42d5-8db7-0b547df270ca-host-slash\") pod \"iptables-alerter-mnlz6\" (UID: \"6f5bcfa1-3cac-42d5-8db7-0b547df270ca\") " pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-system-cni-dir\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-etc-openvswitch\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-run-k8s-cni-cncf-io\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474457 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-conf-dir\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474480 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-var-lib-kubelet\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474508 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpftz\" (UniqueName: \"kubernetes.io/projected/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-kube-api-access-tpftz\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-slash\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474557 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-run-systemd\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474580 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-env-overrides\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-hostroot\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.476315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-sysconfig\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-kubernetes\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf7zp\" (UniqueName: \"kubernetes.io/projected/d06fa857-a932-4daf-b686-a0e47fbc56cc-kube-api-access-cf7zp\") pod \"node-ca-bsx4x\" (UID: \"d06fa857-a932-4daf-b686-a0e47fbc56cc\") " pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64nzd\" (UniqueName: \"kubernetes.io/projected/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-kube-api-access-64nzd\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba81491f-9a23-4ab5-9874-72a3829459d5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-socket-dir-parent\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474811 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-host\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474812 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-run-multus-certs\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474839 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-slash\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474848 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-run-multus-certs\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c0a27a5-7204-4798-998b-e1e2c1d199ed-agent-certs\") pod \"konnectivity-agent-zjcsl\" (UID: \"2c0a27a5-7204-4798-998b-e1e2c1d199ed\") " pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474889 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-run-systemd\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c0a27a5-7204-4798-998b-e1e2c1d199ed-konnectivity-ca\") pod \"konnectivity-agent-zjcsl\" (UID: \"2c0a27a5-7204-4798-998b-e1e2c1d199ed\") " pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474926 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-ovnkube-script-lib\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474987 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-hostroot\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-sysconfig\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f5bcfa1-3cac-42d5-8db7-0b547df270ca-host-slash\") pod \"iptables-alerter-mnlz6\" (UID: \"6f5bcfa1-3cac-42d5-8db7-0b547df270ca\") " pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.476934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-system-cni-dir\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475113 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-etc-openvswitch\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-host-run-k8s-cni-cncf-io\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-conf-dir\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475243 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-var-lib-kubelet\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475379 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-env-overrides\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475446 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-kubernetes\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-ovn-node-metrics-cert\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.474755 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-ovnkube-config\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475661 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-socket-dir-parent\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.475904 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba81491f-9a23-4ab5-9874-72a3829459d5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.476069 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/10fc3aab-3208-41f0-abb4-40f376cb9cec-multus-daemon-config\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.476362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2c0a27a5-7204-4798-998b-e1e2c1d199ed-konnectivity-ca\") pod \"konnectivity-agent-zjcsl\" (UID: \"2c0a27a5-7204-4798-998b-e1e2c1d199ed\") " pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.476407 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-tmp\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.476429 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10fc3aab-3208-41f0-abb4-40f376cb9cec-cni-binary-copy\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.477493 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.476829 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-etc-tuned\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.478077 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.478045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2c0a27a5-7204-4798-998b-e1e2c1d199ed-agent-certs\") pod \"konnectivity-agent-zjcsl\" (UID: \"2c0a27a5-7204-4798-998b-e1e2c1d199ed\") " pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:27:39.478136 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.478119 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:27:39.478136 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.478134 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:27:39.478204 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.478146 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4x98g for pod openshift-network-diagnostics/network-check-target-dqd6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:39.478281 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.478219 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g podName:471957f3-589b-4e77-a9be-a4699944a36c nodeName:}" failed. No retries permitted until 2026-06-11 21:27:39.978205383 +0000 UTC m=+3.126146515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4x98g" (UniqueName: "kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g") pod "network-check-target-dqd6m" (UID: "471957f3-589b-4e77-a9be-a4699944a36c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:39.481316 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.481295 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbtbs\" (UniqueName: \"kubernetes.io/projected/10fc3aab-3208-41f0-abb4-40f376cb9cec-kube-api-access-hbtbs\") pod \"multus-jpsm4\" (UID: \"10fc3aab-3208-41f0-abb4-40f376cb9cec\") " pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.481421 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.481370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4bcc\" (UniqueName: \"kubernetes.io/projected/6f5bcfa1-3cac-42d5-8db7-0b547df270ca-kube-api-access-d4bcc\") pod \"iptables-alerter-mnlz6\" (UID: \"6f5bcfa1-3cac-42d5-8db7-0b547df270ca\") " pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.481703 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.481679 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgg2\" (UniqueName: \"kubernetes.io/projected/6add5816-4e1b-45b7-822d-e1c6c8dfe32d-kube-api-access-2sgg2\") pod \"ovnkube-node-dfnmq\" (UID: \"6add5816-4e1b-45b7-822d-e1c6c8dfe32d\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.481832 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.481813 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g2cn\" (UniqueName: \"kubernetes.io/projected/ba81491f-9a23-4ab5-9874-72a3829459d5-kube-api-access-6g2cn\") pod \"multus-additional-cni-plugins-z7k92\" (UID: \"ba81491f-9a23-4ab5-9874-72a3829459d5\") " pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.489102 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.489080 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpftz\" (UniqueName: \"kubernetes.io/projected/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-kube-api-access-tpftz\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:39.490997 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.490943 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf7zp\" (UniqueName: \"kubernetes.io/projected/d06fa857-a932-4daf-b686-a0e47fbc56cc-kube-api-access-cf7zp\") pod \"node-ca-bsx4x\" (UID: \"d06fa857-a932-4daf-b686-a0e47fbc56cc\") " pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.491968 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.491950 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64nzd\" (UniqueName: \"kubernetes.io/projected/a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce-kube-api-access-64nzd\") pod \"tuned-b4gm9\" (UID: \"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce\") " pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.567587 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.567555 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-965jb" Jun 11 21:27:39.575424 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.575394 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" Jun 11 21:27:39.584217 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.584190 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:27:39.590296 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.590276 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" Jun 11 21:27:39.596810 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.596787 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bsx4x" Jun 11 21:27:39.602627 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.602609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:27:39.609967 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.609943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z7k92" Jun 11 21:27:39.616781 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.616758 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mnlz6" Jun 11 21:27:39.623248 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.623224 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jpsm4" Jun 11 21:27:39.758894 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.758826 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:27:39.878773 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.878733 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:39.878953 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.878918 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:39.879019 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.878998 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret podName:38176311-61fa-4cea-9fbf-258415da1d0f nodeName:}" failed. No retries permitted until 2026-06-11 21:27:40.878975594 +0000 UTC m=+4.026916731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret") pod "global-pull-secret-syncer-b8b29" (UID: "38176311-61fa-4cea-9fbf-258415da1d0f") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:39.979929 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.979896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x98g\" (UniqueName: \"kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g\") pod \"network-check-target-dqd6m\" (UID: \"471957f3-589b-4e77-a9be-a4699944a36c\") " pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:39.980090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:39.979977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:39.980090 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.980079 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:27:39.980186 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.980106 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:27:39.980186 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.980120 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4x98g for pod openshift-network-diagnostics/network-check-target-dqd6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:39.980186 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.980088 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:39.980186 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.980182 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g podName:471957f3-589b-4e77-a9be-a4699944a36c nodeName:}" failed. No retries permitted until 2026-06-11 21:27:40.980162153 +0000 UTC m=+4.128103291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4x98g" (UniqueName: "kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g") pod "network-check-target-dqd6m" (UID: "471957f3-589b-4e77-a9be-a4699944a36c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:39.980365 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:39.980239 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs podName:050b45ae-ece1-41ae-a59b-f8f81db2cf7e nodeName:}" failed. No retries permitted until 2026-06-11 21:27:40.980219728 +0000 UTC m=+4.128160874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs") pod "network-metrics-daemon-4t9th" (UID: "050b45ae-ece1-41ae-a59b-f8f81db2cf7e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:40.092381 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:40.092353 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba81491f_9a23_4ab5_9874_72a3829459d5.slice/crio-1867d58b9d2b602ef0c30ecedecbb8cba781ad7a67c32f0836e44a483ac10f34 WatchSource:0}: Error finding container 1867d58b9d2b602ef0c30ecedecbb8cba781ad7a67c32f0836e44a483ac10f34: Status 404 returned error can't find the container with id 1867d58b9d2b602ef0c30ecedecbb8cba781ad7a67c32f0836e44a483ac10f34 Jun 11 21:27:40.094037 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:40.094014 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06fa857_a932_4daf_b686_a0e47fbc56cc.slice/crio-6eaa425a22c2aeeb98632863a84ff7fc897d1d747cb5ff98aa406a70a59f4393 WatchSource:0}: Error finding container 6eaa425a22c2aeeb98632863a84ff7fc897d1d747cb5ff98aa406a70a59f4393: Status 404 returned error can't find the container with id 6eaa425a22c2aeeb98632863a84ff7fc897d1d747cb5ff98aa406a70a59f4393 Jun 11 21:27:40.095772 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:40.095697 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1fffbaa_28f7_47d8_b5db_a8e7dbee2f23.slice/crio-41abaa59a755db8dcd7eafb795664fb295885413baf2c9040ca00ba2eb29cf67 WatchSource:0}: Error finding container 41abaa59a755db8dcd7eafb795664fb295885413baf2c9040ca00ba2eb29cf67: Status 404 returned error can't find the container with id 41abaa59a755db8dcd7eafb795664fb295885413baf2c9040ca00ba2eb29cf67 Jun 11 21:27:40.097451 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:40.097426 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d5fcf7_ebd1_4498_9bda_6d2d39f425ce.slice/crio-770d80c964e04e52e30c1aac933d23603efe6759623f22c7718b51ba578c8fcc WatchSource:0}: Error finding container 770d80c964e04e52e30c1aac933d23603efe6759623f22c7718b51ba578c8fcc: Status 404 returned error can't find the container with id 770d80c964e04e52e30c1aac933d23603efe6759623f22c7718b51ba578c8fcc Jun 11 21:27:40.098317 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:40.098300 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5bcfa1_3cac_42d5_8db7_0b547df270ca.slice/crio-819898460ffcac0b715a5261ad1396e9674d6dd6795dee7b5da3e7a976a6aecb WatchSource:0}: Error finding container 819898460ffcac0b715a5261ad1396e9674d6dd6795dee7b5da3e7a976a6aecb: Status 404 returned error can't find the container with id 819898460ffcac0b715a5261ad1396e9674d6dd6795dee7b5da3e7a976a6aecb Jun 11 21:27:40.099475 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:40.099223 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10fc3aab_3208_41f0_abb4_40f376cb9cec.slice/crio-e7d52cacf9c7eb62f692540cef772c89c2a59ebb0c35b49422b5e4662e480c82 WatchSource:0}: Error finding container e7d52cacf9c7eb62f692540cef772c89c2a59ebb0c35b49422b5e4662e480c82: Status 404 returned error can't find the container with id e7d52cacf9c7eb62f692540cef772c89c2a59ebb0c35b49422b5e4662e480c82 Jun 11 21:27:40.100789 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:40.100716 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod972afe0f_4814_4604_8da4_69353be4c5b9.slice/crio-0fb8ca24b356fb0c8911da591ac4ec83a15347ed804454fea54af81a651013db WatchSource:0}: Error finding container 0fb8ca24b356fb0c8911da591ac4ec83a15347ed804454fea54af81a651013db: Status 404 returned error can't find the container with id 0fb8ca24b356fb0c8911da591ac4ec83a15347ed804454fea54af81a651013db Jun 11 21:27:40.102384 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:40.102304 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0a27a5_7204_4798_998b_e1e2c1d199ed.slice/crio-2a385992efc5ec13bd76231bc924065e0c690526cee5d8ee66944ea93adfb5eb WatchSource:0}: Error finding container 2a385992efc5ec13bd76231bc924065e0c690526cee5d8ee66944ea93adfb5eb: Status 404 returned error can't find the container with id 2a385992efc5ec13bd76231bc924065e0c690526cee5d8ee66944ea93adfb5eb Jun 11 21:27:40.103066 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:27:40.103005 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6add5816_4e1b_45b7_822d_e1c6c8dfe32d.slice/crio-b55f5d89da350818857a3497dae13b7a23ec8053eef8c191b63fc16b80e9c762 WatchSource:0}: Error finding container b55f5d89da350818857a3497dae13b7a23ec8053eef8c191b63fc16b80e9c762: Status 404 returned error can't find the container with id b55f5d89da350818857a3497dae13b7a23ec8053eef8c191b63fc16b80e9c762 Jun 11 21:27:40.304439 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.304204 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:22:39 +0000 UTC" deadline="2028-01-11 04:57:37.514164728 +0000 UTC" Jun 11 21:27:40.304439 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.304436 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13879h29m57.209733427s" Jun 11 21:27:40.342641 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.342605 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zjcsl" event={"ID":"2c0a27a5-7204-4798-998b-e1e2c1d199ed","Type":"ContainerStarted","Data":"2a385992efc5ec13bd76231bc924065e0c690526cee5d8ee66944ea93adfb5eb"} Jun 11 21:27:40.343728 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.343702 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" event={"ID":"972afe0f-4814-4604-8da4-69353be4c5b9","Type":"ContainerStarted","Data":"0fb8ca24b356fb0c8911da591ac4ec83a15347ed804454fea54af81a651013db"} Jun 11 21:27:40.344692 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.344663 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jpsm4" event={"ID":"10fc3aab-3208-41f0-abb4-40f376cb9cec","Type":"ContainerStarted","Data":"e7d52cacf9c7eb62f692540cef772c89c2a59ebb0c35b49422b5e4662e480c82"} Jun 11 21:27:40.345554 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.345534 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mnlz6" event={"ID":"6f5bcfa1-3cac-42d5-8db7-0b547df270ca","Type":"ContainerStarted","Data":"819898460ffcac0b715a5261ad1396e9674d6dd6795dee7b5da3e7a976a6aecb"} Jun 11 21:27:40.346452 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.346427 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-965jb" event={"ID":"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23","Type":"ContainerStarted","Data":"41abaa59a755db8dcd7eafb795664fb295885413baf2c9040ca00ba2eb29cf67"} Jun 11 21:27:40.347357 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.347339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bsx4x" event={"ID":"d06fa857-a932-4daf-b686-a0e47fbc56cc","Type":"ContainerStarted","Data":"6eaa425a22c2aeeb98632863a84ff7fc897d1d747cb5ff98aa406a70a59f4393"} Jun 11 21:27:40.348705 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.348675 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7k92" event={"ID":"ba81491f-9a23-4ab5-9874-72a3829459d5","Type":"ContainerStarted","Data":"1867d58b9d2b602ef0c30ecedecbb8cba781ad7a67c32f0836e44a483ac10f34"} Jun 11 21:27:40.350443 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.350420 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" event={"ID":"5c49f7a7525b890c85efe14ae9aca6d6","Type":"ContainerStarted","Data":"5bdd5f2564514b213d867d804a0793d5ae27c4a7de332f0b833b270584b9502a"} Jun 11 21:27:40.351601 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.351577 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" event={"ID":"6add5816-4e1b-45b7-822d-e1c6c8dfe32d","Type":"ContainerStarted","Data":"b55f5d89da350818857a3497dae13b7a23ec8053eef8c191b63fc16b80e9c762"} Jun 11 21:27:40.352558 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.352535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" event={"ID":"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce","Type":"ContainerStarted","Data":"770d80c964e04e52e30c1aac933d23603efe6759623f22c7718b51ba578c8fcc"} Jun 11 21:27:40.365348 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.365306 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" podStartSLOduration=2.365292779 podStartE2EDuration="2.365292779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:27:40.365154359 +0000 UTC m=+3.513095508" watchObservedRunningTime="2026-06-11 21:27:40.365292779 +0000 UTC m=+3.513233928" Jun 11 21:27:40.890445 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.890400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:40.890667 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:40.890571 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:40.890667 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:40.890639 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret podName:38176311-61fa-4cea-9fbf-258415da1d0f nodeName:}" failed. No retries permitted until 2026-06-11 21:27:42.890620244 +0000 UTC m=+6.038561374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret") pod "global-pull-secret-syncer-b8b29" (UID: "38176311-61fa-4cea-9fbf-258415da1d0f") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:40.991520 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.991378 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:40.991520 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:40.991444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x98g\" (UniqueName: \"kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g\") pod \"network-check-target-dqd6m\" (UID: \"471957f3-589b-4e77-a9be-a4699944a36c\") " pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:40.991789 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:40.991587 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:27:40.991789 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:40.991607 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:27:40.991789 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:40.991620 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4x98g for pod openshift-network-diagnostics/network-check-target-dqd6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:40.991789 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:40.991750 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:40.991983 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:40.991810 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs podName:050b45ae-ece1-41ae-a59b-f8f81db2cf7e nodeName:}" failed. No retries permitted until 2026-06-11 21:27:42.99178884 +0000 UTC m=+6.139729973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs") pod "network-metrics-daemon-4t9th" (UID: "050b45ae-ece1-41ae-a59b-f8f81db2cf7e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:40.992317 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:40.992180 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g podName:471957f3-589b-4e77-a9be-a4699944a36c nodeName:}" failed. No retries permitted until 2026-06-11 21:27:42.992160489 +0000 UTC m=+6.140101620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4x98g" (UniqueName: "kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g") pod "network-check-target-dqd6m" (UID: "471957f3-589b-4e77-a9be-a4699944a36c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:41.305296 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:41.305162 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:22:39 +0000 UTC" deadline="2028-03-21 17:43:59.918437424 +0000 UTC" Jun 11 21:27:41.305296 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:41.305198 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15572h16m18.613244569s" Jun 11 21:27:41.305874 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:41.305808 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:27:41.337749 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:41.336791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:41.337749 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:41.336929 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:41.337749 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:41.337402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:41.337749 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:41.337524 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:41.337749 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:41.337606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:41.337749 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:41.337713 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:41.357976 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:41.357776 2578 generic.go:356] "Generic (PLEG): container finished" podID="c2e25a248d0719a18fd9dec0d31556fb" containerID="5659f48b99cdc4ae8ef3f1babbac236093b48f8b3870347bbfea332720b1cdec" exitCode=0 Jun 11 21:27:41.357976 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:41.357913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" event={"ID":"c2e25a248d0719a18fd9dec0d31556fb","Type":"ContainerDied","Data":"5659f48b99cdc4ae8ef3f1babbac236093b48f8b3870347bbfea332720b1cdec"} Jun 11 21:27:42.392677 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:42.392338 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" event={"ID":"c2e25a248d0719a18fd9dec0d31556fb","Type":"ContainerStarted","Data":"1d4c3dc6093309e912cb9b3d0d86a436280cb808134dd06a82ab45ca53989852"} Jun 11 21:27:42.410740 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:42.410098 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" podStartSLOduration=4.410074399 podStartE2EDuration="4.410074399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:27:42.408947692 +0000 UTC m=+5.556888844" watchObservedRunningTime="2026-06-11 21:27:42.410074399 +0000 UTC m=+5.558015557" Jun 11 21:27:42.907898 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:42.907853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:42.908089 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:42.908071 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:42.908153 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:42.908139 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret podName:38176311-61fa-4cea-9fbf-258415da1d0f nodeName:}" failed. No retries permitted until 2026-06-11 21:27:46.908120712 +0000 UTC m=+10.056061840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret") pod "global-pull-secret-syncer-b8b29" (UID: "38176311-61fa-4cea-9fbf-258415da1d0f") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:43.008488 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:43.008456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:43.008682 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:43.008522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x98g\" (UniqueName: \"kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g\") pod \"network-check-target-dqd6m\" (UID: \"471957f3-589b-4e77-a9be-a4699944a36c\") " pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:43.008682 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:43.008618 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:43.008682 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:43.008675 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:27:43.008867 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:43.008692 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:27:43.008867 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:43.008705 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4x98g for pod openshift-network-diagnostics/network-check-target-dqd6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:43.008867 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:43.008719 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs podName:050b45ae-ece1-41ae-a59b-f8f81db2cf7e nodeName:}" failed. No retries permitted until 2026-06-11 21:27:47.008679373 +0000 UTC m=+10.156620517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs") pod "network-metrics-daemon-4t9th" (UID: "050b45ae-ece1-41ae-a59b-f8f81db2cf7e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:43.008867 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:43.008741 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g podName:471957f3-589b-4e77-a9be-a4699944a36c nodeName:}" failed. No retries permitted until 2026-06-11 21:27:47.00873093 +0000 UTC m=+10.156672057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4x98g" (UniqueName: "kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g") pod "network-check-target-dqd6m" (UID: "471957f3-589b-4e77-a9be-a4699944a36c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:43.335516 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:43.334954 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:43.335516 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:43.335094 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:43.335516 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:43.335394 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:43.335806 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:43.335510 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:43.335806 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:43.335580 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:43.335806 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:43.335692 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:45.334787 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:45.334745 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:45.335230 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:45.334761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:45.335230 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:45.334875 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:45.335230 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:45.334971 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:45.335230 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:45.335023 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:45.335230 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:45.335096 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:46.942504 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:46.942459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:46.943070 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:46.942633 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:46.943070 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:46.942729 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret podName:38176311-61fa-4cea-9fbf-258415da1d0f nodeName:}" failed. No retries permitted until 2026-06-11 21:27:54.942707426 +0000 UTC m=+18.090648552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret") pod "global-pull-secret-syncer-b8b29" (UID: "38176311-61fa-4cea-9fbf-258415da1d0f") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:47.043474 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:47.043353 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x98g\" (UniqueName: \"kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g\") pod \"network-check-target-dqd6m\" (UID: \"471957f3-589b-4e77-a9be-a4699944a36c\") " pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:47.043474 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:47.043460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:47.043709 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:47.043554 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:27:47.043709 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:47.043581 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:27:47.043709 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:47.043589 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:47.043709 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:47.043595 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4x98g for pod openshift-network-diagnostics/network-check-target-dqd6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:47.043709 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:47.043672 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs podName:050b45ae-ece1-41ae-a59b-f8f81db2cf7e nodeName:}" failed. No retries permitted until 2026-06-11 21:27:55.043638674 +0000 UTC m=+18.191579816 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs") pod "network-metrics-daemon-4t9th" (UID: "050b45ae-ece1-41ae-a59b-f8f81db2cf7e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:47.043709 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:47.043695 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g podName:471957f3-589b-4e77-a9be-a4699944a36c nodeName:}" failed. No retries permitted until 2026-06-11 21:27:55.043683585 +0000 UTC m=+18.191624718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4x98g" (UniqueName: "kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g") pod "network-check-target-dqd6m" (UID: "471957f3-589b-4e77-a9be-a4699944a36c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:47.335378 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:47.335301 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:47.335514 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:47.335431 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:47.336836 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:47.336812 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:47.337071 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:47.336897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:47.337185 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:47.337158 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:47.337185 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:47.337170 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:49.334848 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:49.334813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:49.335349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:49.334813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:49.335349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:49.334955 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:49.335349 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:49.334951 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:49.335349 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:49.335053 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:49.335349 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:49.335153 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:51.335200 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:51.335098 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:51.335636 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:51.335098 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:51.335636 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:51.335231 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:51.335636 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:51.335112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:51.335636 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:51.335329 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:51.335636 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:51.335420 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:53.335517 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:53.335419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:53.335517 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:53.335458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:53.335517 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:53.335426 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:53.336090 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:53.335548 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:53.336090 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:53.335629 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:53.336090 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:53.335711 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:55.000518 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:55.000476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:55.000939 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.000617 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:55.000939 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.000701 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret podName:38176311-61fa-4cea-9fbf-258415da1d0f nodeName:}" failed. No retries permitted until 2026-06-11 21:28:11.000683079 +0000 UTC m=+34.148624206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret") pod "global-pull-secret-syncer-b8b29" (UID: "38176311-61fa-4cea-9fbf-258415da1d0f") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:27:55.101076 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:55.101036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x98g\" (UniqueName: \"kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g\") pod \"network-check-target-dqd6m\" (UID: \"471957f3-589b-4e77-a9be-a4699944a36c\") " pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:55.101247 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:55.101103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:55.101247 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.101204 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:55.101247 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.101207 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:27:55.101247 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.101232 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:27:55.101247 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.101245 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4x98g for pod openshift-network-diagnostics/network-check-target-dqd6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:55.101452 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.101271 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs podName:050b45ae-ece1-41ae-a59b-f8f81db2cf7e nodeName:}" failed. No retries permitted until 2026-06-11 21:28:11.101254551 +0000 UTC m=+34.249195686 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs") pod "network-metrics-daemon-4t9th" (UID: "050b45ae-ece1-41ae-a59b-f8f81db2cf7e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:27:55.101452 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.101295 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g podName:471957f3-589b-4e77-a9be-a4699944a36c nodeName:}" failed. No retries permitted until 2026-06-11 21:28:11.101280914 +0000 UTC m=+34.249222041 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4x98g" (UniqueName: "kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g") pod "network-check-target-dqd6m" (UID: "471957f3-589b-4e77-a9be-a4699944a36c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:27:55.334988 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:55.334903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:55.335140 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:55.334906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:55.335140 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.335043 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:55.335140 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.335112 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:55.335140 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:55.334916 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:55.335356 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:55.335208 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:57.335294 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:57.335264 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:57.335791 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:57.335360 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:57.335791 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:57.335405 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:57.335791 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:57.335527 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:57.335791 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:57.335564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:57.335791 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:57.335669 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:59.334851 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.334552 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:27:59.335484 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.334559 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:27:59.335484 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:59.334929 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:27:59.335484 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.334609 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:27:59.335484 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:59.334993 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:27:59.335484 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:27:59.335096 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:27:59.429302 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.429163 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zjcsl" event={"ID":"2c0a27a5-7204-4798-998b-e1e2c1d199ed","Type":"ContainerStarted","Data":"e4b43012abb5fbec99089780051140b9bb38c1d2512e61df59b85e75211cd6fc"} Jun 11 21:27:59.430933 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.430904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" event={"ID":"972afe0f-4814-4604-8da4-69353be4c5b9","Type":"ContainerStarted","Data":"ef61ca244825f8a86a36fdd6bf799340cf257723815a42338e9e106d8cabefdd"} Jun 11 21:27:59.432740 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.432680 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jpsm4" event={"ID":"10fc3aab-3208-41f0-abb4-40f376cb9cec","Type":"ContainerStarted","Data":"42cb67c8491d9020bc8a6901f1d0ac5e64228bcdc022ba8afc9eab97609d6b50"} Jun 11 21:27:59.434359 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.434335 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-965jb" event={"ID":"a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23","Type":"ContainerStarted","Data":"87f2edc35d93f9bf699e2e32db1cbc0d3a358f5b900b7b01d184f07c6555cc71"} Jun 11 21:27:59.436166 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.436141 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bsx4x" event={"ID":"d06fa857-a932-4daf-b686-a0e47fbc56cc","Type":"ContainerStarted","Data":"58be42d4ba0f68d1e47cd17b0b4b6d7d45ebce44a0fb9ca718f22e14ddc7b391"} Jun 11 21:27:59.437872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.437846 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba81491f-9a23-4ab5-9874-72a3829459d5" containerID="072fbd53b4328c5fd7f79dcbefe5151a7493250e4bf030520d56b1bf207f9425" exitCode=0 Jun 11 21:27:59.437971 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.437917 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7k92" event={"ID":"ba81491f-9a23-4ab5-9874-72a3829459d5","Type":"ContainerDied","Data":"072fbd53b4328c5fd7f79dcbefe5151a7493250e4bf030520d56b1bf207f9425"} Jun 11 21:27:59.441169 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.441149 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:27:59.441677 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.441638 2578 generic.go:356] "Generic (PLEG): container finished" podID="6add5816-4e1b-45b7-822d-e1c6c8dfe32d" containerID="0eb8e39d2a27123f24165333014b10ad341e532d9c8e52051f8dad98bdf906c4" exitCode=1 Jun 11 21:27:59.441776 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.441722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" event={"ID":"6add5816-4e1b-45b7-822d-e1c6c8dfe32d","Type":"ContainerStarted","Data":"ac5a603e94162e5415e590bb74e51f97d3a69327ca17f50110bf7ca1c1f64b81"} Jun 11 21:27:59.441839 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.441786 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" event={"ID":"6add5816-4e1b-45b7-822d-e1c6c8dfe32d","Type":"ContainerStarted","Data":"bef32d6ff08ff75418f3b2e34de7fd0c0d98e914c59615767f8c88f8667b4e8b"} Jun 11 21:27:59.441899 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.441838 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" event={"ID":"6add5816-4e1b-45b7-822d-e1c6c8dfe32d","Type":"ContainerStarted","Data":"c0ec20041593cd1340c629597d139822f4f373106731fcd32e514bccb28c3343"} Jun 11 21:27:59.441899 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.441887 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" event={"ID":"6add5816-4e1b-45b7-822d-e1c6c8dfe32d","Type":"ContainerStarted","Data":"6bcc169774a18f2643437b0f2d824d1633e5871a5d9d32f7d3dc73c2f93a930c"} Jun 11 21:27:59.441995 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.441931 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" event={"ID":"6add5816-4e1b-45b7-822d-e1c6c8dfe32d","Type":"ContainerDied","Data":"0eb8e39d2a27123f24165333014b10ad341e532d9c8e52051f8dad98bdf906c4"} Jun 11 21:27:59.441995 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.441978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" event={"ID":"6add5816-4e1b-45b7-822d-e1c6c8dfe32d","Type":"ContainerStarted","Data":"ad2284a21c87497ebaf100dd1d5bf3453d226bb2fcefc6a255dcabf8a70f1fe1"} Jun 11 21:27:59.443380 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.443359 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" event={"ID":"a0d5fcf7-ebd1-4498-9bda-6d2d39f425ce","Type":"ContainerStarted","Data":"50370ccade34e5c3cbbcb966091f20c179ee1db479b01b4f1d2debeb44c90e5d"} Jun 11 21:27:59.464134 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.464066 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zjcsl" podStartSLOduration=8.737917249 podStartE2EDuration="22.464046s" totalImagesPullingTime="13.726128751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:27:59.448193784 +0000 UTC m=+22.596134936" watchObservedRunningTime="2026-06-11 21:27:59.464046 +0000 UTC m=+22.611987150" Jun 11 21:27:59.464298 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.464225 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b4gm9" podStartSLOduration=3.965624121 podStartE2EDuration="22.464215839s" totalImagesPullingTime="18.498591718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:27:59.463586216 +0000 UTC m=+22.611527374" watchObservedRunningTime="2026-06-11 21:27:59.464215839 +0000 UTC m=+22.612156999" Jun 11 21:27:59.477576 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.477532 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bsx4x" podStartSLOduration=3.979249618 podStartE2EDuration="22.477517801s" totalImagesPullingTime="18.498268183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:27:59.477192798 +0000 UTC m=+22.625133947" watchObservedRunningTime="2026-06-11 21:27:59.477517801 +0000 UTC m=+22.625458976" Jun 11 21:27:59.531870 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.531813 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-965jb" podStartSLOduration=4.034773815 podStartE2EDuration="22.531791589s" totalImagesPullingTime="18.497017774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:27:59.53150636 +0000 UTC m=+22.679447510" watchObservedRunningTime="2026-06-11 21:27:59.531791589 +0000 UTC m=+22.679732741" Jun 11 21:27:59.532120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:27:59.532097 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jpsm4" podStartSLOduration=4.019184826 podStartE2EDuration="22.53208946s" totalImagesPullingTime="18.512904634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:27:59.517058314 +0000 UTC m=+22.664999466" watchObservedRunningTime="2026-06-11 21:27:59.53208946 +0000 UTC m=+22.680030661" Jun 11 21:28:00.428422 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:00.428395 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 21:28:00.447279 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:00.447251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" event={"ID":"972afe0f-4814-4604-8da4-69353be4c5b9","Type":"ContainerStarted","Data":"9467baeae72b4d136c7ca195278b0454804749e443d97e8200ed1270090fa145"} Jun 11 21:28:00.448710 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:00.448686 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mnlz6" event={"ID":"6f5bcfa1-3cac-42d5-8db7-0b547df270ca","Type":"ContainerStarted","Data":"ced1621267b7f7a105a46f0a558d72b56a4bdccd8d78c9d670ef4850993e35ec"} Jun 11 21:28:00.462700 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:00.462636 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mnlz6" podStartSLOduration=9.732613599 podStartE2EDuration="23.462623974s" totalImagesPullingTime="13.730010375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:00.462321692 +0000 UTC m=+23.610262841" watchObservedRunningTime="2026-06-11 21:28:00.462623974 +0000 UTC m=+23.610565122" Jun 11 21:28:01.328116 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:01.328005 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T21:28:00.428415612Z","UUID":"8f20fcc3-1a12-4b78-9dcd-eeeda218ee54","Handler":null,"Name":"","Endpoint":""} Jun 11 21:28:01.329504 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:01.329474 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 21:28:01.329664 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:01.329517 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 21:28:01.335519 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:01.335492 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:01.335684 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:01.335525 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:28:01.335684 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:01.335493 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:01.335684 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:01.335608 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:28:01.335855 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:01.335683 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:28:01.335855 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:01.335761 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:28:02.457073 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:02.456900 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:28:02.457595 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:02.457564 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" event={"ID":"6add5816-4e1b-45b7-822d-e1c6c8dfe32d","Type":"ContainerStarted","Data":"41a1188592631e968505c3aea9f703d7a0f20d4ac42e12615a9ddee5e8f8e906"} Jun 11 21:28:02.459873 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:02.459849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" event={"ID":"972afe0f-4814-4604-8da4-69353be4c5b9","Type":"ContainerStarted","Data":"c62ec7355eae7a9d6c75fa4b7da9788e0d6284413563bc19e5488d5b7020a94b"} Jun 11 21:28:02.479153 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:02.479103 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pgdfd" podStartSLOduration=4.367021279 podStartE2EDuration="25.479087738s" totalImagesPullingTime="21.112066459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:02.478227339 +0000 UTC m=+25.626168491" watchObservedRunningTime="2026-06-11 21:28:02.479087738 +0000 UTC m=+25.627028909" Jun 11 21:28:03.335159 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:03.335106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:28:03.335159 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:03.335137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:03.335401 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:03.335106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:03.335401 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:03.335250 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:28:03.335401 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:03.335313 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:28:03.335401 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:03.335380 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:28:03.881418 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:03.881384 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:28:03.924228 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:03.924200 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:28:03.924771 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:03.924745 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:28:04.465443 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:04.465417 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zjcsl" Jun 11 21:28:05.335286 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:05.335035 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:05.335286 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:05.335095 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:05.335967 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:05.335305 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:28:05.335967 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:05.335103 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:28:05.335967 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:05.335363 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:28:05.335967 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:05.335504 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:28:05.468221 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:05.468189 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba81491f-9a23-4ab5-9874-72a3829459d5" containerID="f2405a70bb2ff0aad1bccd1ac8beafe5dc6af22a52f3d5bb129396c81582fef3" exitCode=0 Jun 11 21:28:05.468353 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:05.468252 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7k92" event={"ID":"ba81491f-9a23-4ab5-9874-72a3829459d5","Type":"ContainerDied","Data":"f2405a70bb2ff0aad1bccd1ac8beafe5dc6af22a52f3d5bb129396c81582fef3"} Jun 11 21:28:05.471823 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:05.471806 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:28:05.472230 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:05.472204 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" event={"ID":"6add5816-4e1b-45b7-822d-e1c6c8dfe32d","Type":"ContainerStarted","Data":"bf980756bbbaf3107773a6733434e4a11cfbe806c3ca8b8bad840335e3dd9a97"} Jun 11 21:28:05.472429 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:05.472399 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:28:05.472563 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:05.472549 2578 scope.go:117] "RemoveContainer" containerID="0eb8e39d2a27123f24165333014b10ad341e532d9c8e52051f8dad98bdf906c4" Jun 11 21:28:05.487606 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:05.487587 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:28:06.480251 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.480228 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:28:06.480685 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.480640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" event={"ID":"6add5816-4e1b-45b7-822d-e1c6c8dfe32d","Type":"ContainerStarted","Data":"ce4fbceeffd285bc8709a60b481af533ca6fffcc434412aac7258670d5b4f078"} Jun 11 21:28:06.481278 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.481260 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 21:28:06.481613 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.481535 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:28:06.499903 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.499877 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:28:06.511414 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.511372 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" podStartSLOduration=10.97101891 podStartE2EDuration="29.511357607s" totalImagesPullingTime="18.540338697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:06.510571042 +0000 UTC m=+29.658512192" watchObservedRunningTime="2026-06-11 21:28:06.511357607 +0000 UTC m=+29.659298755" Jun 11 21:28:06.965002 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.964965 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4t9th"] Jun 11 21:28:06.965142 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.965102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:28:06.965238 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:06.965219 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:28:06.968225 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.968200 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqd6m"] Jun 11 21:28:06.968363 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.968287 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:06.968428 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:06.968358 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:28:06.968902 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.968880 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8b29"] Jun 11 21:28:06.969007 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:06.968953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:06.969060 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:06.969013 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:28:07.484639 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:07.484605 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba81491f-9a23-4ab5-9874-72a3829459d5" containerID="99ec820e75b35bb6e8892c2ada5762320303d7b7fa930195ef5d5d990643a345" exitCode=0 Jun 11 21:28:07.485016 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:07.484692 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7k92" event={"ID":"ba81491f-9a23-4ab5-9874-72a3829459d5","Type":"ContainerDied","Data":"99ec820e75b35bb6e8892c2ada5762320303d7b7fa930195ef5d5d990643a345"} Jun 11 21:28:07.485016 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:07.484771 2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 21:28:08.181502 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:08.181416 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:28:08.335507 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:08.335478 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:28:08.335626 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:08.335481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:08.335626 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:08.335587 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:28:08.335731 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:08.335707 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:28:09.334974 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:09.334943 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:09.335320 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:09.335079 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:28:09.490306 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:09.490274 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba81491f-9a23-4ab5-9874-72a3829459d5" containerID="1d653a62cf51f5e86ec5c10bb955e4c5c650360723ece1a9b1595db011d8dcaa" exitCode=0 Jun 11 21:28:09.490469 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:09.490352 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7k92" event={"ID":"ba81491f-9a23-4ab5-9874-72a3829459d5","Type":"ContainerDied","Data":"1d653a62cf51f5e86ec5c10bb955e4c5c650360723ece1a9b1595db011d8dcaa"} Jun 11 21:28:09.508220 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:09.508174 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" podUID="6add5816-4e1b-45b7-822d-e1c6c8dfe32d" containerName="ovnkube-controller" probeResult="failure" output="" Jun 11 21:28:10.334540 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:10.334503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:28:10.334540 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:10.334524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:10.334783 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:10.334636 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dqd6m" podUID="471957f3-589b-4e77-a9be-a4699944a36c" Jun 11 21:28:10.334783 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:10.334759 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:28:11.027970 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.027929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:11.028605 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.028133 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:28:11.028605 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.028212 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret podName:38176311-61fa-4cea-9fbf-258415da1d0f nodeName:}" failed. No retries permitted until 2026-06-11 21:28:43.02819319 +0000 UTC m=+66.176134344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret") pod "global-pull-secret-syncer-b8b29" (UID: "38176311-61fa-4cea-9fbf-258415da1d0f") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:28:11.129225 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.129192 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:28:11.129449 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.129246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x98g\" (UniqueName: \"kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g\") pod \"network-check-target-dqd6m\" (UID: \"471957f3-589b-4e77-a9be-a4699944a36c\") " pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:11.129449 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.129398 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:28:11.129449 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.129418 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:28:11.129449 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.129439 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:28:11.129449 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.129452 2578 projected.go:196] Error preparing data for projected volume kube-api-access-4x98g for pod openshift-network-diagnostics/network-check-target-dqd6m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:28:11.129640 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.129470 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs podName:050b45ae-ece1-41ae-a59b-f8f81db2cf7e nodeName:}" failed. No retries permitted until 2026-06-11 21:28:43.129449839 +0000 UTC m=+66.277390968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs") pod "network-metrics-daemon-4t9th" (UID: "050b45ae-ece1-41ae-a59b-f8f81db2cf7e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:28:11.129640 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.129501 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g podName:471957f3-589b-4e77-a9be-a4699944a36c nodeName:}" failed. No retries permitted until 2026-06-11 21:28:43.129486515 +0000 UTC m=+66.277427645 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4x98g" (UniqueName: "kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g") pod "network-check-target-dqd6m" (UID: "471957f3-589b-4e77-a9be-a4699944a36c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:28:11.335307 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.335175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:11.335400 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.335306 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b8b29" podUID="38176311-61fa-4cea-9fbf-258415da1d0f" Jun 11 21:28:11.617677 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.617580 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeReady" Jun 11 21:28:11.617843 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.617768 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 21:28:11.663801 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.663766 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jnqmc"] Jun 11 21:28:11.686214 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.686176 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w4slm"] Jun 11 21:28:11.686390 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.686298 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.689590 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.689377 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 21:28:11.689590 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.689464 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 21:28:11.689590 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.689469 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kf2x8\"" Jun 11 21:28:11.701394 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.701372 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jnqmc"] Jun 11 21:28:11.701507 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.701415 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4slm"] Jun 11 21:28:11.701507 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.701482 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4slm" Jun 11 21:28:11.704519 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.704487 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 21:28:11.704640 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.704528 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 21:28:11.704640 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.704528 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6s9pz\"" Jun 11 21:28:11.704640 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.704594 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 21:28:11.833631 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.833596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.833828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.833665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26373a4a-7b9f-4023-bf1e-71e354fe85e4-cert\") pod \"ingress-canary-w4slm\" (UID: \"26373a4a-7b9f-4023-bf1e-71e354fe85e4\") " pod="openshift-ingress-canary/ingress-canary-w4slm" Jun 11 21:28:11.833828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.833731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4131642-3181-49b5-a6ff-e144ceae9785-config-volume\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.833828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.833761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4131642-3181-49b5-a6ff-e144ceae9785-tmp-dir\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.833828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.833789 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjht9\" (UniqueName: \"kubernetes.io/projected/b4131642-3181-49b5-a6ff-e144ceae9785-kube-api-access-wjht9\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.833988 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.833830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56rvd\" (UniqueName: \"kubernetes.io/projected/26373a4a-7b9f-4023-bf1e-71e354fe85e4-kube-api-access-56rvd\") pod \"ingress-canary-w4slm\" (UID: \"26373a4a-7b9f-4023-bf1e-71e354fe85e4\") " pod="openshift-ingress-canary/ingress-canary-w4slm" Jun 11 21:28:11.935022 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.934935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26373a4a-7b9f-4023-bf1e-71e354fe85e4-cert\") pod \"ingress-canary-w4slm\" (UID: \"26373a4a-7b9f-4023-bf1e-71e354fe85e4\") " pod="openshift-ingress-canary/ingress-canary-w4slm" Jun 11 21:28:11.935192 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.935027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4131642-3181-49b5-a6ff-e144ceae9785-config-volume\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.935192 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.935064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4131642-3181-49b5-a6ff-e144ceae9785-tmp-dir\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.935192 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.935089 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjht9\" (UniqueName: \"kubernetes.io/projected/b4131642-3181-49b5-a6ff-e144ceae9785-kube-api-access-wjht9\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.935192 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.935131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56rvd\" (UniqueName: \"kubernetes.io/projected/26373a4a-7b9f-4023-bf1e-71e354fe85e4-kube-api-access-56rvd\") pod \"ingress-canary-w4slm\" (UID: \"26373a4a-7b9f-4023-bf1e-71e354fe85e4\") " pod="openshift-ingress-canary/ingress-canary-w4slm" Jun 11 21:28:11.935192 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.935167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.935382 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.935278 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:28:11.935382 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:11.935381 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls podName:b4131642-3181-49b5-a6ff-e144ceae9785 nodeName:}" failed. No retries permitted until 2026-06-11 21:28:12.435361939 +0000 UTC m=+35.583303080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls") pod "dns-default-jnqmc" (UID: "b4131642-3181-49b5-a6ff-e144ceae9785") : secret "dns-default-metrics-tls" not found Jun 11 21:28:11.935909 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.935586 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b4131642-3181-49b5-a6ff-e144ceae9785-config-volume\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.935909 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.935873 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4131642-3181-49b5-a6ff-e144ceae9785-tmp-dir\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.939796 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.939773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26373a4a-7b9f-4023-bf1e-71e354fe85e4-cert\") pod \"ingress-canary-w4slm\" (UID: \"26373a4a-7b9f-4023-bf1e-71e354fe85e4\") " pod="openshift-ingress-canary/ingress-canary-w4slm" Jun 11 21:28:11.944990 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.944963 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjht9\" (UniqueName: \"kubernetes.io/projected/b4131642-3181-49b5-a6ff-e144ceae9785-kube-api-access-wjht9\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:11.945630 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:11.945610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56rvd\" (UniqueName: \"kubernetes.io/projected/26373a4a-7b9f-4023-bf1e-71e354fe85e4-kube-api-access-56rvd\") pod \"ingress-canary-w4slm\" (UID: \"26373a4a-7b9f-4023-bf1e-71e354fe85e4\") " pod="openshift-ingress-canary/ingress-canary-w4slm" Jun 11 21:28:12.009442 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.009408 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w4slm" Jun 11 21:28:12.231351 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.231109 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w4slm"] Jun 11 21:28:12.235678 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:28:12.235631 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26373a4a_7b9f_4023_bf1e_71e354fe85e4.slice/crio-abcee5e81cc35d8a4f7e8d50077e5e61d99e376a1e0af34459f1256ea67a2acb WatchSource:0}: Error finding container abcee5e81cc35d8a4f7e8d50077e5e61d99e376a1e0af34459f1256ea67a2acb: Status 404 returned error can't find the container with id abcee5e81cc35d8a4f7e8d50077e5e61d99e376a1e0af34459f1256ea67a2acb Jun 11 21:28:12.335115 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.335085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:28:12.335270 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.335093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:12.338422 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.338374 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:28:12.338422 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.338379 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:28:12.338422 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.338414 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:28:12.339896 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.339870 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w6bx8\"" Jun 11 21:28:12.339896 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.339891 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cmhqk\"" Jun 11 21:28:12.439093 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.439060 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:12.439269 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:12.439231 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:28:12.439336 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:12.439298 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls podName:b4131642-3181-49b5-a6ff-e144ceae9785 nodeName:}" failed. No retries permitted until 2026-06-11 21:28:13.439280302 +0000 UTC m=+36.587221434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls") pod "dns-default-jnqmc" (UID: "b4131642-3181-49b5-a6ff-e144ceae9785") : secret "dns-default-metrics-tls" not found Jun 11 21:28:12.502366 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.502254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4slm" event={"ID":"26373a4a-7b9f-4023-bf1e-71e354fe85e4","Type":"ContainerStarted","Data":"abcee5e81cc35d8a4f7e8d50077e5e61d99e376a1e0af34459f1256ea67a2acb"} Jun 11 21:28:12.676549 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.676518 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq"] Jun 11 21:28:12.683791 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.683771 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" Jun 11 21:28:12.688828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.688799 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 21:28:12.688828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.688810 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bhm77\"" Jun 11 21:28:12.688993 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.688865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 21:28:12.689346 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.689137 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 21:28:12.689346 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.689139 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 21:28:12.689680 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.689642 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq"] Jun 11 21:28:12.841464 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.841427 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d5a41d0-ec97-47f5-a87c-11bbf5fddc41-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq\" (UID: \"6d5a41d0-ec97-47f5-a87c-11bbf5fddc41\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" Jun 11 21:28:12.841628 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.841505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq96l\" (UniqueName: \"kubernetes.io/projected/6d5a41d0-ec97-47f5-a87c-11bbf5fddc41-kube-api-access-mq96l\") pod \"managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq\" (UID: \"6d5a41d0-ec97-47f5-a87c-11bbf5fddc41\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" Jun 11 21:28:12.942301 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.942271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq96l\" (UniqueName: \"kubernetes.io/projected/6d5a41d0-ec97-47f5-a87c-11bbf5fddc41-kube-api-access-mq96l\") pod \"managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq\" (UID: \"6d5a41d0-ec97-47f5-a87c-11bbf5fddc41\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" Jun 11 21:28:12.942476 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.942366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d5a41d0-ec97-47f5-a87c-11bbf5fddc41-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq\" (UID: \"6d5a41d0-ec97-47f5-a87c-11bbf5fddc41\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" Jun 11 21:28:12.945953 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.945929 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d5a41d0-ec97-47f5-a87c-11bbf5fddc41-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq\" (UID: \"6d5a41d0-ec97-47f5-a87c-11bbf5fddc41\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" Jun 11 21:28:12.950890 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:12.950850 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq96l\" (UniqueName: \"kubernetes.io/projected/6d5a41d0-ec97-47f5-a87c-11bbf5fddc41-kube-api-access-mq96l\") pod \"managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq\" (UID: \"6d5a41d0-ec97-47f5-a87c-11bbf5fddc41\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" Jun 11 21:28:13.000788 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:13.000761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" Jun 11 21:28:13.335603 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:13.335569 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:13.338824 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:13.338802 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:28:13.446607 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:13.446575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:13.446800 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:13.446765 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:28:13.446867 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:13.446854 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls podName:b4131642-3181-49b5-a6ff-e144ceae9785 nodeName:}" failed. No retries permitted until 2026-06-11 21:28:15.446831555 +0000 UTC m=+38.594772687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls") pod "dns-default-jnqmc" (UID: "b4131642-3181-49b5-a6ff-e144ceae9785") : secret "dns-default-metrics-tls" not found Jun 11 21:28:13.926011 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:13.925973 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq"] Jun 11 21:28:13.930821 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:28:13.930732 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d5a41d0_ec97_47f5_a87c_11bbf5fddc41.slice/crio-0cafe618b43083e6de8a1c3277e5417301e3a335192e3ae2f663a760fd3092ea WatchSource:0}: Error finding container 0cafe618b43083e6de8a1c3277e5417301e3a335192e3ae2f663a760fd3092ea: Status 404 returned error can't find the container with id 0cafe618b43083e6de8a1c3277e5417301e3a335192e3ae2f663a760fd3092ea Jun 11 21:28:14.510404 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:14.510369 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba81491f-9a23-4ab5-9874-72a3829459d5" containerID="a6c768c58aa5c8cbb11b3cc9ba7f08569a20dbd88e8276504e534ad48129f653" exitCode=0 Jun 11 21:28:14.510868 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:14.510461 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7k92" event={"ID":"ba81491f-9a23-4ab5-9874-72a3829459d5","Type":"ContainerDied","Data":"a6c768c58aa5c8cbb11b3cc9ba7f08569a20dbd88e8276504e534ad48129f653"} Jun 11 21:28:14.511752 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:14.511730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" event={"ID":"6d5a41d0-ec97-47f5-a87c-11bbf5fddc41","Type":"ContainerStarted","Data":"0cafe618b43083e6de8a1c3277e5417301e3a335192e3ae2f663a760fd3092ea"} Jun 11 21:28:15.464621 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:15.464396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:15.464804 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:15.464569 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:28:15.464804 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:15.464747 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls podName:b4131642-3181-49b5-a6ff-e144ceae9785 nodeName:}" failed. No retries permitted until 2026-06-11 21:28:19.464723075 +0000 UTC m=+42.612664208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls") pod "dns-default-jnqmc" (UID: "b4131642-3181-49b5-a6ff-e144ceae9785") : secret "dns-default-metrics-tls" not found Jun 11 21:28:15.517315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:15.517291 2578 generic.go:356] "Generic (PLEG): container finished" podID="ba81491f-9a23-4ab5-9874-72a3829459d5" containerID="9b9cc13f68b044239ee1126fc52f3d0e44bdff18082d3e85d74756829c9bbb15" exitCode=0 Jun 11 21:28:15.517727 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:15.517327 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7k92" event={"ID":"ba81491f-9a23-4ab5-9874-72a3829459d5","Type":"ContainerDied","Data":"9b9cc13f68b044239ee1126fc52f3d0e44bdff18082d3e85d74756829c9bbb15"} Jun 11 21:28:16.521289 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:16.521252 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w4slm" event={"ID":"26373a4a-7b9f-4023-bf1e-71e354fe85e4","Type":"ContainerStarted","Data":"29ba8705d11f2f6952f9c121822c1837828da8512fa773abbdea0f1920ade560"} Jun 11 21:28:16.528173 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:16.528142 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z7k92" event={"ID":"ba81491f-9a23-4ab5-9874-72a3829459d5","Type":"ContainerStarted","Data":"9513f28f1ca142e06731020eb20b08fe3d9e2143b93aeef9f49efa74c256d59e"} Jun 11 21:28:16.537455 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:16.537413 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w4slm" podStartSLOduration=2.280541957 podStartE2EDuration="5.537393404s" totalImagesPullingTime="3.256851447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:16.536974434 +0000 UTC m=+39.684915584" watchObservedRunningTime="2026-06-11 21:28:16.537393404 +0000 UTC m=+39.685334538" Jun 11 21:28:16.559128 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:16.559029 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z7k92" podStartSLOduration=9.033143588 podStartE2EDuration="39.559010792s" totalImagesPullingTime="30.525867204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:16.557006877 +0000 UTC m=+39.704948028" watchObservedRunningTime="2026-06-11 21:28:16.559010792 +0000 UTC m=+39.706951955" Jun 11 21:28:17.531737 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:17.531696 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" event={"ID":"6d5a41d0-ec97-47f5-a87c-11bbf5fddc41","Type":"ContainerStarted","Data":"39f5de97a1dbc4b99c962c8e56eb2bd17279c8b04facca894db49b6091353b52"} Jun 11 21:28:17.547247 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:17.547201 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" podStartSLOduration=2.785866483 podStartE2EDuration="5.547185735s" totalImagesPullingTime="2.761319252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:17.546314553 +0000 UTC m=+40.694255702" watchObservedRunningTime="2026-06-11 21:28:17.547185735 +0000 UTC m=+40.695126943" Jun 11 21:28:19.492964 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:19.492911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:19.493352 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:19.493062 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:28:19.493352 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:19.493122 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls podName:b4131642-3181-49b5-a6ff-e144ceae9785 nodeName:}" failed. No retries permitted until 2026-06-11 21:28:27.493107131 +0000 UTC m=+50.641048257 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls") pod "dns-default-jnqmc" (UID: "b4131642-3181-49b5-a6ff-e144ceae9785") : secret "dns-default-metrics-tls" not found Jun 11 21:28:27.550317 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:27.550280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:27.550780 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:27.550422 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:28:27.550780 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:27.550482 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls podName:b4131642-3181-49b5-a6ff-e144ceae9785 nodeName:}" failed. No retries permitted until 2026-06-11 21:28:43.550468251 +0000 UTC m=+66.698409381 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls") pod "dns-default-jnqmc" (UID: "b4131642-3181-49b5-a6ff-e144ceae9785") : secret "dns-default-metrics-tls" not found Jun 11 21:28:39.500352 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:39.500325 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfnmq" Jun 11 21:28:43.048456 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.048411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:43.051176 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.051160 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:28:43.062462 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.062431 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/38176311-61fa-4cea-9fbf-258415da1d0f-original-pull-secret\") pod \"global-pull-secret-syncer-b8b29\" (UID: \"38176311-61fa-4cea-9fbf-258415da1d0f\") " pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:43.148876 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.148834 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:28:43.149042 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.148897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x98g\" (UniqueName: \"kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g\") pod \"network-check-target-dqd6m\" (UID: \"471957f3-589b-4e77-a9be-a4699944a36c\") " pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:43.151822 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.151802 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:28:43.151878 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.151823 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:28:43.159080 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:43.159059 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:28:43.159152 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:43.159118 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs podName:050b45ae-ece1-41ae-a59b-f8f81db2cf7e nodeName:}" failed. No retries permitted until 2026-06-11 21:29:47.159102261 +0000 UTC m=+130.307043389 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs") pod "network-metrics-daemon-4t9th" (UID: "050b45ae-ece1-41ae-a59b-f8f81db2cf7e") : secret "metrics-daemon-secret" not found Jun 11 21:28:43.161444 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.161430 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:28:43.172033 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.172012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x98g\" (UniqueName: \"kubernetes.io/projected/471957f3-589b-4e77-a9be-a4699944a36c-kube-api-access-4x98g\") pod \"network-check-target-dqd6m\" (UID: \"471957f3-589b-4e77-a9be-a4699944a36c\") " pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:43.255708 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.255681 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w6bx8\"" Jun 11 21:28:43.263004 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.262979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:43.345737 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.345715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b8b29" Jun 11 21:28:43.385811 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.385775 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dqd6m"] Jun 11 21:28:43.389748 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:28:43.389721 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471957f3_589b_4e77_a9be_a4699944a36c.slice/crio-91a6af4e0962de4a1bf2138718ec1d004c855c78c35f93d92d3c607731a05002 WatchSource:0}: Error finding container 91a6af4e0962de4a1bf2138718ec1d004c855c78c35f93d92d3c607731a05002: Status 404 returned error can't find the container with id 91a6af4e0962de4a1bf2138718ec1d004c855c78c35f93d92d3c607731a05002 Jun 11 21:28:43.482304 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.482274 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b8b29"] Jun 11 21:28:43.485545 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:28:43.485514 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38176311_61fa_4cea_9fbf_258415da1d0f.slice/crio-f193130bf4761f8b510b6bc2f66d7acf116757e9031f4f688af871ff0f9b6385 WatchSource:0}: Error finding container f193130bf4761f8b510b6bc2f66d7acf116757e9031f4f688af871ff0f9b6385: Status 404 returned error can't find the container with id f193130bf4761f8b510b6bc2f66d7acf116757e9031f4f688af871ff0f9b6385 Jun 11 21:28:43.551519 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.551481 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:28:43.551666 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:43.551625 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:28:43.551723 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:28:43.551709 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls podName:b4131642-3181-49b5-a6ff-e144ceae9785 nodeName:}" failed. No retries permitted until 2026-06-11 21:29:15.551694193 +0000 UTC m=+98.699635321 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls") pod "dns-default-jnqmc" (UID: "b4131642-3181-49b5-a6ff-e144ceae9785") : secret "dns-default-metrics-tls" not found Jun 11 21:28:43.589586 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.589510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8b29" event={"ID":"38176311-61fa-4cea-9fbf-258415da1d0f","Type":"ContainerStarted","Data":"f193130bf4761f8b510b6bc2f66d7acf116757e9031f4f688af871ff0f9b6385"} Jun 11 21:28:43.590524 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:43.590504 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqd6m" event={"ID":"471957f3-589b-4e77-a9be-a4699944a36c","Type":"ContainerStarted","Data":"91a6af4e0962de4a1bf2138718ec1d004c855c78c35f93d92d3c607731a05002"} Jun 11 21:28:48.604661 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:48.604550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b8b29" event={"ID":"38176311-61fa-4cea-9fbf-258415da1d0f","Type":"ContainerStarted","Data":"276f6256c95f3aaa039aed1f129c4f6866549c514bbd3e9382bfc0ffbfc6d6de"} Jun 11 21:28:48.606006 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:48.605982 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dqd6m" event={"ID":"471957f3-589b-4e77-a9be-a4699944a36c","Type":"ContainerStarted","Data":"44f2b1662c85dad90da0f1cd2df70d0e6f93610d04ece49f686ae1d9c3545937"} Jun 11 21:28:48.606116 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:48.606100 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:28:48.621530 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:48.621492 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b8b29" podStartSLOduration=66.83729872 podStartE2EDuration="1m11.621479515s" totalImagesPullingTime="4.784180795s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:48.621071872 +0000 UTC m=+71.769013022" watchObservedRunningTime="2026-06-11 21:28:48.621479515 +0000 UTC m=+71.769420664" Jun 11 21:28:48.636133 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:28:48.636098 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dqd6m" podStartSLOduration=66.758607311 podStartE2EDuration="1m11.636086853s" totalImagesPullingTime="4.877479542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:28:48.635905104 +0000 UTC m=+71.783846253" watchObservedRunningTime="2026-06-11 21:28:48.636086853 +0000 UTC m=+71.784028002" Jun 11 21:29:15.570671 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:29:15.570615 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:29:15.571141 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:29:15.570760 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:29:15.571141 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:29:15.570821 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls podName:b4131642-3181-49b5-a6ff-e144ceae9785 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:19.570806047 +0000 UTC m=+162.718747174 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls") pod "dns-default-jnqmc" (UID: "b4131642-3181-49b5-a6ff-e144ceae9785") : secret "dns-default-metrics-tls" not found Jun 11 21:29:19.610867 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:29:19.610830 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dqd6m" Jun 11 21:29:47.179807 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:29:47.179769 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:29:47.180341 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:29:47.179897 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:29:47.180341 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:29:47.179984 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs podName:050b45ae-ece1-41ae-a59b-f8f81db2cf7e nodeName:}" failed. No retries permitted until 2026-06-11 21:31:49.179965531 +0000 UTC m=+252.327906675 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs") pod "network-metrics-daemon-4t9th" (UID: "050b45ae-ece1-41ae-a59b-f8f81db2cf7e") : secret "metrics-daemon-secret" not found Jun 11 21:30:14.697707 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:14.697590 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jnqmc" podUID="b4131642-3181-49b5-a6ff-e144ceae9785" Jun 11 21:30:14.811097 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:14.811068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jnqmc" Jun 11 21:30:15.346342 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:15.346305 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4t9th" podUID="050b45ae-ece1-41ae-a59b-f8f81db2cf7e" Jun 11 21:30:17.819384 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:17.819354 2578 generic.go:356] "Generic (PLEG): container finished" podID="6d5a41d0-ec97-47f5-a87c-11bbf5fddc41" containerID="39f5de97a1dbc4b99c962c8e56eb2bd17279c8b04facca894db49b6091353b52" exitCode=255 Jun 11 21:30:17.819384 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:17.819388 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" event={"ID":"6d5a41d0-ec97-47f5-a87c-11bbf5fddc41","Type":"ContainerDied","Data":"39f5de97a1dbc4b99c962c8e56eb2bd17279c8b04facca894db49b6091353b52"} Jun 11 21:30:17.824808 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:17.824788 2578 scope.go:117] "RemoveContainer" containerID="39f5de97a1dbc4b99c962c8e56eb2bd17279c8b04facca894db49b6091353b52" Jun 11 21:30:18.824191 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:18.824159 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58d6d7c4b4-6f2kq" event={"ID":"6d5a41d0-ec97-47f5-a87c-11bbf5fddc41","Type":"ContainerStarted","Data":"7dded7519a899de4611428addee98eef46450a63dd9d5ddde15410708ce45643"} Jun 11 21:30:19.590514 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:19.590471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:30:19.590703 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:19.590578 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:30:19.590703 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:19.590634 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls podName:b4131642-3181-49b5-a6ff-e144ceae9785 nodeName:}" failed. No retries permitted until 2026-06-11 21:32:21.590618618 +0000 UTC m=+284.738559744 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls") pod "dns-default-jnqmc" (UID: "b4131642-3181-49b5-a6ff-e144ceae9785") : secret "dns-default-metrics-tls" not found Jun 11 21:30:29.334901 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.334866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:30:29.875089 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.875058 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x"] Jun 11 21:30:29.877029 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.877008 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc"] Jun 11 21:30:29.877173 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.877130 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:29.879623 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.879602 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv"] Jun 11 21:30:29.879727 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.879705 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:29.880224 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.880199 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 21:30:29.880313 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.880297 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 21:30:29.880371 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.880334 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:30:29.880371 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.880344 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 21:30:29.880530 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.880510 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-l9x5r\"" Jun 11 21:30:29.881635 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.881617 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:29.882525 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.882507 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 21:30:29.882813 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.882789 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-p5fv5\"" Jun 11 21:30:29.883175 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.883156 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 21:30:29.885480 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.884879 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 21:30:29.885480 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.884897 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:30:29.885480 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.884969 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 21:30:29.885480 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.885004 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 21:30:29.885480 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.885138 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jm94q\"" Jun 11 21:30:29.885480 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.885180 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 21:30:29.886914 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.886895 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x"] Jun 11 21:30:29.892743 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.892724 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv"] Jun 11 21:30:29.902349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.902326 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc"] Jun 11 21:30:29.958195 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.958167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:29.958323 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.958203 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcgbg\" (UniqueName: \"kubernetes.io/projected/8e33d48e-9524-47e7-b1a6-6d11f4c7d584-kube-api-access-kcgbg\") pod \"service-ca-operator-7ccbfd59dc-vt69x\" (UID: \"8e33d48e-9524-47e7-b1a6-6d11f4c7d584\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:29.958323 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.958238 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf7gh\" (UniqueName: \"kubernetes.io/projected/9c400a8c-ef0c-4525-9016-73a000d7f1ca-kube-api-access-pf7gh\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:29.958323 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.958298 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e33d48e-9524-47e7-b1a6-6d11f4c7d584-config\") pod \"service-ca-operator-7ccbfd59dc-vt69x\" (UID: \"8e33d48e-9524-47e7-b1a6-6d11f4c7d584\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:29.958456 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.958336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c400a8c-ef0c-4525-9016-73a000d7f1ca-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:29.958456 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.958401 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:29.958456 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.958424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcfxp\" (UniqueName: \"kubernetes.io/projected/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-kube-api-access-dcfxp\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:29.958456 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.958440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e33d48e-9524-47e7-b1a6-6d11f4c7d584-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-vt69x\" (UID: \"8e33d48e-9524-47e7-b1a6-6d11f4c7d584\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:29.965296 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.965277 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-plcgz"] Jun 11 21:30:29.967770 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.967750 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-plcgz" Jun 11 21:30:29.971439 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.971419 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-2jzq7\"" Jun 11 21:30:29.971619 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.971606 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-8tk5t"] Jun 11 21:30:29.973505 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.973483 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7bd9d485dd-lrv8r"] Jun 11 21:30:29.973766 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.973620 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:29.975443 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.975425 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:29.976935 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.976919 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 21:30:29.977180 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.977168 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 21:30:29.977758 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.977742 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 21:30:29.978308 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.978282 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 21:30:29.978592 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.978578 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gpx6n\"" Jun 11 21:30:29.978695 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.978594 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lkrj9\"" Jun 11 21:30:29.978695 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.978577 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 21:30:29.978695 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.978688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 21:30:29.978854 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.978788 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 21:30:29.979396 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.979382 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 21:30:29.979833 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.979817 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 21:30:29.980152 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.980134 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 21:30:29.983354 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.983333 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-plcgz"] Jun 11 21:30:29.984204 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.984184 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 21:30:29.988893 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.988874 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-8tk5t"] Jun 11 21:30:29.989790 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:29.989770 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bd9d485dd-lrv8r"] Jun 11 21:30:30.059570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.059536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:30.059570 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.059575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-stats-auth\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.059844 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.059597 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcgbg\" (UniqueName: \"kubernetes.io/projected/8e33d48e-9524-47e7-b1a6-6d11f4c7d584-kube-api-access-kcgbg\") pod \"service-ca-operator-7ccbfd59dc-vt69x\" (UID: \"8e33d48e-9524-47e7-b1a6-6d11f4c7d584\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:30.059844 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.059613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.059844 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.059642 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf7gh\" (UniqueName: \"kubernetes.io/projected/9c400a8c-ef0c-4525-9016-73a000d7f1ca-kube-api-access-pf7gh\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:30.059844 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.059685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj9dv\" (UniqueName: \"kubernetes.io/projected/a2e8ffc2-68a9-4f70-8a9f-d4dc17d885bb-kube-api-access-gj9dv\") pod \"network-check-source-6947749cfc-plcgz\" (UID: \"a2e8ffc2-68a9-4f70-8a9f-d4dc17d885bb\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-plcgz" Jun 11 21:30:30.059844 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.059715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c400a8c-ef0c-4525-9016-73a000d7f1ca-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:30.059844 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.059722 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:30.059844 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.059740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76228efd-e9f7-4877-a884-462c175462bd-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.059844 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.059809 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls podName:9c400a8c-ef0c-4525-9016-73a000d7f1ca nodeName:}" failed. No retries permitted until 2026-06-11 21:30:30.559787098 +0000 UTC m=+173.707728230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fcnkc" (UID: "9c400a8c-ef0c-4525-9016-73a000d7f1ca") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.059955 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76228efd-e9f7-4877-a884-462c175462bd-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcfxp\" (UniqueName: \"kubernetes.io/projected/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-kube-api-access-dcfxp\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060033 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76228efd-e9f7-4877-a884-462c175462bd-serving-cert\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df5j9\" (UniqueName: \"kubernetes.io/projected/c172843b-7283-481f-a7b9-bb5378f186c6-kube-api-access-df5j9\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060086 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e33d48e-9524-47e7-b1a6-6d11f4c7d584-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-vt69x\" (UID: \"8e33d48e-9524-47e7-b1a6-6d11f4c7d584\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060179 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnc9l\" (UniqueName: \"kubernetes.io/projected/76228efd-e9f7-4877-a884-462c175462bd-kube-api-access-qnc9l\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.060193 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060201 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/76228efd-e9f7-4877-a884-462c175462bd-snapshots\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060232 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76228efd-e9f7-4877-a884-462c175462bd-tmp\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.060243 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.060250 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls podName:77d64d6e-d1ba-4be7-9279-f79133ca9ee1 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:30.560233073 +0000 UTC m=+173.708174214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls") pod "cluster-samples-operator-9547488fd-dhmhv" (UID: "77d64d6e-d1ba-4be7-9279-f79133ca9ee1") : secret "samples-operator-tls" not found Jun 11 21:30:30.060713 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e33d48e-9524-47e7-b1a6-6d11f4c7d584-config\") pod \"service-ca-operator-7ccbfd59dc-vt69x\" (UID: \"8e33d48e-9524-47e7-b1a6-6d11f4c7d584\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:30.060713 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060326 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.060713 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-default-certificate\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.060713 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060501 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9c400a8c-ef0c-4525-9016-73a000d7f1ca-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:30.060857 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.060727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e33d48e-9524-47e7-b1a6-6d11f4c7d584-config\") pod \"service-ca-operator-7ccbfd59dc-vt69x\" (UID: \"8e33d48e-9524-47e7-b1a6-6d11f4c7d584\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:30.062247 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.062232 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e33d48e-9524-47e7-b1a6-6d11f4c7d584-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-vt69x\" (UID: \"8e33d48e-9524-47e7-b1a6-6d11f4c7d584\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:30.067966 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.067941 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cbc68c555-pqhld"] Jun 11 21:30:30.070084 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.070071 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.074004 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.073985 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 21:30:30.074105 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.073995 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 21:30:30.074105 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.074006 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wm67l\"" Jun 11 21:30:30.074209 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.074121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcfxp\" (UniqueName: \"kubernetes.io/projected/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-kube-api-access-dcfxp\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:30.074209 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.074008 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 21:30:30.075212 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.075188 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcgbg\" (UniqueName: \"kubernetes.io/projected/8e33d48e-9524-47e7-b1a6-6d11f4c7d584-kube-api-access-kcgbg\") pod \"service-ca-operator-7ccbfd59dc-vt69x\" (UID: \"8e33d48e-9524-47e7-b1a6-6d11f4c7d584\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:30.076339 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.076309 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf7gh\" (UniqueName: \"kubernetes.io/projected/9c400a8c-ef0c-4525-9016-73a000d7f1ca-kube-api-access-pf7gh\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:30.080064 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.080041 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 21:30:30.084981 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.084962 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cbc68c555-pqhld"] Jun 11 21:30:30.160921 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.160861 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj9dv\" (UniqueName: \"kubernetes.io/projected/a2e8ffc2-68a9-4f70-8a9f-d4dc17d885bb-kube-api-access-gj9dv\") pod \"network-check-source-6947749cfc-plcgz\" (UID: \"a2e8ffc2-68a9-4f70-8a9f-d4dc17d885bb\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-plcgz" Jun 11 21:30:30.160921 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.160888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76228efd-e9f7-4877-a884-462c175462bd-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.160921 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.160909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76228efd-e9f7-4877-a884-462c175462bd-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.161126 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.160929 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76228efd-e9f7-4877-a884-462c175462bd-serving-cert\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.161126 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.160954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df5j9\" (UniqueName: \"kubernetes.io/projected/c172843b-7283-481f-a7b9-bb5378f186c6-kube-api-access-df5j9\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.161126 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161000 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-trusted-ca\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.161126 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-installation-pull-secrets\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.161126 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-certificates\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.161126 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnc9l\" (UniqueName: \"kubernetes.io/projected/76228efd-e9f7-4877-a884-462c175462bd-kube-api-access-qnc9l\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.161403 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/76228efd-e9f7-4877-a884-462c175462bd-snapshots\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.161403 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161164 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-ca-trust-extracted\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.161403 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161190 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76228efd-e9f7-4877-a884-462c175462bd-tmp\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.161403 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-bound-sa-token\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.161403 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.161403 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-default-certificate\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.161403 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161382 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.161828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcs4z\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-kube-api-access-kcs4z\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.161828 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.161450 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle podName:c172843b-7283-481f-a7b9-bb5378f186c6 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:30.661430913 +0000 UTC m=+173.809372057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle") pod "router-default-7bd9d485dd-lrv8r" (UID: "c172843b-7283-481f-a7b9-bb5378f186c6") : configmap references non-existent config key: service-ca.crt Jun 11 21:30:30.161828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-stats-auth\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.161828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161525 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-image-registry-private-configuration\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.161828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.161828 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.161684 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:30:30.161828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161487 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76228efd-e9f7-4877-a884-462c175462bd-tmp\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.161828 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.161725 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs podName:c172843b-7283-481f-a7b9-bb5378f186c6 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:30.66171126 +0000 UTC m=+173.809652389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs") pod "router-default-7bd9d485dd-lrv8r" (UID: "c172843b-7283-481f-a7b9-bb5378f186c6") : secret "router-metrics-certs-default" not found Jun 11 21:30:30.161828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161811 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/76228efd-e9f7-4877-a884-462c175462bd-snapshots\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.162202 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.161864 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76228efd-e9f7-4877-a884-462c175462bd-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.162202 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.162001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76228efd-e9f7-4877-a884-462c175462bd-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.163510 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.163488 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/76228efd-e9f7-4877-a884-462c175462bd-serving-cert\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.163825 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.163809 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-stats-auth\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.163986 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.163971 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-default-certificate\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.172469 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.172443 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df5j9\" (UniqueName: \"kubernetes.io/projected/c172843b-7283-481f-a7b9-bb5378f186c6-kube-api-access-df5j9\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.172469 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.172463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnc9l\" (UniqueName: \"kubernetes.io/projected/76228efd-e9f7-4877-a884-462c175462bd-kube-api-access-qnc9l\") pod \"insights-operator-5bbd86d6bd-8tk5t\" (UID: \"76228efd-e9f7-4877-a884-462c175462bd\") " pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.172469 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.172448 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj9dv\" (UniqueName: \"kubernetes.io/projected/a2e8ffc2-68a9-4f70-8a9f-d4dc17d885bb-kube-api-access-gj9dv\") pod \"network-check-source-6947749cfc-plcgz\" (UID: \"a2e8ffc2-68a9-4f70-8a9f-d4dc17d885bb\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-plcgz" Jun 11 21:30:30.188885 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.188869 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" Jun 11 21:30:30.262268 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.262239 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-ca-trust-extracted\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.262268 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.262272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-bound-sa-token\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.262488 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.262414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.262488 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.262448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcs4z\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-kube-api-access-kcs4z\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.262601 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.262493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-image-registry-private-configuration\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.262601 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.262556 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:30:30.262601 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.262566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-trusted-ca\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.262601 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.262578 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbc68c555-pqhld: secret "image-registry-tls" not found Jun 11 21:30:30.262601 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.262591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-installation-pull-secrets\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.262872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.262622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-certificates\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.262872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.262626 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-ca-trust-extracted\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.262872 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.262642 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls podName:5ff5cb9e-70c4-47b1-a353-965e8f2c3c31 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:30.762619859 +0000 UTC m=+173.910560987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls") pod "image-registry-6cbc68c555-pqhld" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31") : secret "image-registry-tls" not found Jun 11 21:30:30.264053 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.263569 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-certificates\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.264830 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.264773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-trusted-ca\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.265719 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.265677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-image-registry-private-configuration\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.265861 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.265835 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-installation-pull-secrets\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.271547 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.271526 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-bound-sa-token\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.271800 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.271783 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcs4z\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-kube-api-access-kcs4z\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.277501 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.277479 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-plcgz" Jun 11 21:30:30.285482 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.285461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" Jun 11 21:30:30.311058 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.311024 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x"] Jun 11 21:30:30.316129 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:30:30.316102 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e33d48e_9524_47e7_b1a6_6d11f4c7d584.slice/crio-3e3628fedca124007b63c7efd7a760270f6a9e0f16ce31e70aa9f9335db57149 WatchSource:0}: Error finding container 3e3628fedca124007b63c7efd7a760270f6a9e0f16ce31e70aa9f9335db57149: Status 404 returned error can't find the container with id 3e3628fedca124007b63c7efd7a760270f6a9e0f16ce31e70aa9f9335db57149 Jun 11 21:30:30.404449 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.404405 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-plcgz"] Jun 11 21:30:30.409132 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:30:30.409097 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e8ffc2_68a9_4f70_8a9f_d4dc17d885bb.slice/crio-be65e89555acfd2729d835eecbe1e0ebdb96a17918b1b1ce3be8732fac0348e9 WatchSource:0}: Error finding container be65e89555acfd2729d835eecbe1e0ebdb96a17918b1b1ce3be8732fac0348e9: Status 404 returned error can't find the container with id be65e89555acfd2729d835eecbe1e0ebdb96a17918b1b1ce3be8732fac0348e9 Jun 11 21:30:30.420038 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.420015 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-8tk5t"] Jun 11 21:30:30.422598 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:30:30.422575 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76228efd_e9f7_4877_a884_462c175462bd.slice/crio-a52955f9f2d27512acbf60ad1f58ed77aa24166cf3094a335420426bb02c2cfa WatchSource:0}: Error finding container a52955f9f2d27512acbf60ad1f58ed77aa24166cf3094a335420426bb02c2cfa: Status 404 returned error can't find the container with id a52955f9f2d27512acbf60ad1f58ed77aa24166cf3094a335420426bb02c2cfa Jun 11 21:30:30.564606 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.564578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:30.564802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.564706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:30.564802 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.564746 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:30:30.564915 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.564806 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls podName:77d64d6e-d1ba-4be7-9279-f79133ca9ee1 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:31.564789714 +0000 UTC m=+174.712730841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls") pod "cluster-samples-operator-9547488fd-dhmhv" (UID: "77d64d6e-d1ba-4be7-9279-f79133ca9ee1") : secret "samples-operator-tls" not found Jun 11 21:30:30.564915 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.564839 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:30.564915 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.564891 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls podName:9c400a8c-ef0c-4525-9016-73a000d7f1ca nodeName:}" failed. No retries permitted until 2026-06-11 21:30:31.564874548 +0000 UTC m=+174.712815692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fcnkc" (UID: "9c400a8c-ef0c-4525-9016-73a000d7f1ca") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:30.666090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.665993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.666090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.666063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:30.666312 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.666161 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle podName:c172843b-7283-481f-a7b9-bb5378f186c6 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:31.666144361 +0000 UTC m=+174.814085488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle") pod "router-default-7bd9d485dd-lrv8r" (UID: "c172843b-7283-481f-a7b9-bb5378f186c6") : configmap references non-existent config key: service-ca.crt Jun 11 21:30:30.666312 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.666160 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:30:30.666312 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.666197 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs podName:c172843b-7283-481f-a7b9-bb5378f186c6 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:31.666190393 +0000 UTC m=+174.814131520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs") pod "router-default-7bd9d485dd-lrv8r" (UID: "c172843b-7283-481f-a7b9-bb5378f186c6") : secret "router-metrics-certs-default" not found Jun 11 21:30:30.767294 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.767261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:30.767454 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.767389 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:30:30.767454 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.767406 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbc68c555-pqhld: secret "image-registry-tls" not found Jun 11 21:30:30.767583 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:30.767467 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls podName:5ff5cb9e-70c4-47b1-a353-965e8f2c3c31 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:31.767447401 +0000 UTC m=+174.915388542 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls") pod "image-registry-6cbc68c555-pqhld" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31") : secret "image-registry-tls" not found Jun 11 21:30:30.859977 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.859942 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-plcgz" event={"ID":"a2e8ffc2-68a9-4f70-8a9f-d4dc17d885bb","Type":"ContainerStarted","Data":"5127fe42ef8d0687233c41d2c016ad56bc1607bc94f2107301d6cb4129e5179b"} Jun 11 21:30:30.860137 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.859999 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-plcgz" event={"ID":"a2e8ffc2-68a9-4f70-8a9f-d4dc17d885bb","Type":"ContainerStarted","Data":"be65e89555acfd2729d835eecbe1e0ebdb96a17918b1b1ce3be8732fac0348e9"} Jun 11 21:30:30.860981 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.860955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" event={"ID":"8e33d48e-9524-47e7-b1a6-6d11f4c7d584","Type":"ContainerStarted","Data":"3e3628fedca124007b63c7efd7a760270f6a9e0f16ce31e70aa9f9335db57149"} Jun 11 21:30:30.862056 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.862035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" event={"ID":"76228efd-e9f7-4877-a884-462c175462bd","Type":"ContainerStarted","Data":"a52955f9f2d27512acbf60ad1f58ed77aa24166cf3094a335420426bb02c2cfa"} Jun 11 21:30:30.875346 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:30.875309 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-plcgz" podStartSLOduration=1.8752920290000001 podStartE2EDuration="1.875292029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:30:30.874881927 +0000 UTC m=+174.022823076" watchObservedRunningTime="2026-06-11 21:30:30.875292029 +0000 UTC m=+174.023233178" Jun 11 21:30:31.574008 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:31.573970 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:31.574350 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:31.574123 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:30:31.574350 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:31.574169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:31.574350 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:31.574184 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls podName:77d64d6e-d1ba-4be7-9279-f79133ca9ee1 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:33.574169084 +0000 UTC m=+176.722110211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls") pod "cluster-samples-operator-9547488fd-dhmhv" (UID: "77d64d6e-d1ba-4be7-9279-f79133ca9ee1") : secret "samples-operator-tls" not found Jun 11 21:30:31.574350 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:31.574251 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:31.574350 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:31.574302 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls podName:9c400a8c-ef0c-4525-9016-73a000d7f1ca nodeName:}" failed. No retries permitted until 2026-06-11 21:30:33.574290957 +0000 UTC m=+176.722232083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fcnkc" (UID: "9c400a8c-ef0c-4525-9016-73a000d7f1ca") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:31.674969 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:31.674933 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:31.675144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:31.675022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:31.675144 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:31.675120 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle podName:c172843b-7283-481f-a7b9-bb5378f186c6 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:33.675098417 +0000 UTC m=+176.823039558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle") pod "router-default-7bd9d485dd-lrv8r" (UID: "c172843b-7283-481f-a7b9-bb5378f186c6") : configmap references non-existent config key: service-ca.crt Jun 11 21:30:31.675276 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:31.675178 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:30:31.675276 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:31.675223 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs podName:c172843b-7283-481f-a7b9-bb5378f186c6 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:33.675209325 +0000 UTC m=+176.823150464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs") pod "router-default-7bd9d485dd-lrv8r" (UID: "c172843b-7283-481f-a7b9-bb5378f186c6") : secret "router-metrics-certs-default" not found Jun 11 21:30:31.776518 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:31.776467 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:31.776818 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:31.776754 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:30:31.776818 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:31.776777 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbc68c555-pqhld: secret "image-registry-tls" not found Jun 11 21:30:31.777120 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:31.776849 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls podName:5ff5cb9e-70c4-47b1-a353-965e8f2c3c31 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:33.776828636 +0000 UTC m=+176.924769788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls") pod "image-registry-6cbc68c555-pqhld" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31") : secret "image-registry-tls" not found Jun 11 21:30:32.869922 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:32.869885 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" event={"ID":"8e33d48e-9524-47e7-b1a6-6d11f4c7d584","Type":"ContainerStarted","Data":"ed692255635b779b850bb3f4c88b392da0b7e7a3b08d7f26b0f4317d4e1be54a"} Jun 11 21:30:32.886323 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:32.886238 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" podStartSLOduration=1.885160497 podStartE2EDuration="3.886218583s" totalImagesPullingTime="2.001058086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:30:32.885513228 +0000 UTC m=+176.033454379" watchObservedRunningTime="2026-06-11 21:30:32.886218583 +0000 UTC m=+176.034159732" Jun 11 21:30:33.594114 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:33.594079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:33.594313 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:33.594138 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:33.594313 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:33.594221 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:33.594313 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:33.594255 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:30:33.594313 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:33.594293 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls podName:9c400a8c-ef0c-4525-9016-73a000d7f1ca nodeName:}" failed. No retries permitted until 2026-06-11 21:30:37.594270779 +0000 UTC m=+180.742211906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fcnkc" (UID: "9c400a8c-ef0c-4525-9016-73a000d7f1ca") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:33.594313 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:33.594310 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls podName:77d64d6e-d1ba-4be7-9279-f79133ca9ee1 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:37.594302891 +0000 UTC m=+180.742244017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls") pod "cluster-samples-operator-9547488fd-dhmhv" (UID: "77d64d6e-d1ba-4be7-9279-f79133ca9ee1") : secret "samples-operator-tls" not found Jun 11 21:30:33.694569 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:33.694538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:33.694734 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:33.694630 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:33.694734 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:33.694723 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle podName:c172843b-7283-481f-a7b9-bb5378f186c6 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:37.694698846 +0000 UTC m=+180.842639984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle") pod "router-default-7bd9d485dd-lrv8r" (UID: "c172843b-7283-481f-a7b9-bb5378f186c6") : configmap references non-existent config key: service-ca.crt Jun 11 21:30:33.694858 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:33.694745 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:30:33.694858 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:33.694789 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs podName:c172843b-7283-481f-a7b9-bb5378f186c6 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:37.694778169 +0000 UTC m=+180.842719297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs") pod "router-default-7bd9d485dd-lrv8r" (UID: "c172843b-7283-481f-a7b9-bb5378f186c6") : secret "router-metrics-certs-default" not found Jun 11 21:30:33.795539 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:33.795506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:33.795698 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:33.795678 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:30:33.795698 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:33.795692 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbc68c555-pqhld: secret "image-registry-tls" not found Jun 11 21:30:33.795778 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:33.795738 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls podName:5ff5cb9e-70c4-47b1-a353-965e8f2c3c31 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:37.795723716 +0000 UTC m=+180.943664849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls") pod "image-registry-6cbc68c555-pqhld" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31") : secret "image-registry-tls" not found Jun 11 21:30:33.874742 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:33.874662 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" event={"ID":"76228efd-e9f7-4877-a884-462c175462bd","Type":"ContainerStarted","Data":"9681802232ced823b17c76f2ed6af48343fb125c826f6181f2e130a21fbac6db"} Jun 11 21:30:33.891775 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:33.891724 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" podStartSLOduration=2.194223618 podStartE2EDuration="4.891709413s" totalImagesPullingTime="2.697485795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:30:33.890695761 +0000 UTC m=+177.038637116" watchObservedRunningTime="2026-06-11 21:30:33.891709413 +0000 UTC m=+177.039650595" Jun 11 21:30:34.238823 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.238732 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l8fbp"] Jun 11 21:30:34.242425 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.242403 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.245175 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.245154 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 21:30:34.245535 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.245507 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 21:30:34.245732 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.245716 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-879w8\"" Jun 11 21:30:34.255942 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.255920 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l8fbp"] Jun 11 21:30:34.400854 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.400822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.400854 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.400857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-992fw\" (UniqueName: \"kubernetes.io/projected/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-api-access-992fw\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.401037 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.400937 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2d5e55e-1604-4d52-bda6-9a32b996b339-crio-socket\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.401037 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.400986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.401037 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.401021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2d5e55e-1604-4d52-bda6-9a32b996b339-data-volume\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.501503 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.501424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2d5e55e-1604-4d52-bda6-9a32b996b339-crio-socket\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.501503 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.501459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.501503 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.501487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2d5e55e-1604-4d52-bda6-9a32b996b339-data-volume\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.501802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.501552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.501802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.501556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2d5e55e-1604-4d52-bda6-9a32b996b339-crio-socket\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.501802 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.501571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-992fw\" (UniqueName: \"kubernetes.io/projected/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-api-access-992fw\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.501802 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:34.501566 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:30:34.501802 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:34.501678 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:30:34.501802 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:34.501697 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm podName:c2d5e55e-1604-4d52-bda6-9a32b996b339 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:35.001677476 +0000 UTC m=+178.149618622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8fbp" (UID: "c2d5e55e-1604-4d52-bda6-9a32b996b339") : configmap "kube-rbac-proxy" not found Jun 11 21:30:34.501802 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:34.501733 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls podName:c2d5e55e-1604-4d52-bda6-9a32b996b339 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:35.001720173 +0000 UTC m=+178.149661304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8fbp" (UID: "c2d5e55e-1604-4d52-bda6-9a32b996b339") : secret "insights-runtime-extractor-tls" not found Jun 11 21:30:34.502125 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.501840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2d5e55e-1604-4d52-bda6-9a32b996b339-data-volume\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:34.510115 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:34.510093 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-992fw\" (UniqueName: \"kubernetes.io/projected/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-api-access-992fw\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:35.005582 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:35.005549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:35.006018 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:35.005684 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:30:35.006018 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:35.005715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:35.006018 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:35.005751 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm podName:c2d5e55e-1604-4d52-bda6-9a32b996b339 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:36.005731628 +0000 UTC m=+179.153672762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8fbp" (UID: "c2d5e55e-1604-4d52-bda6-9a32b996b339") : configmap "kube-rbac-proxy" not found Jun 11 21:30:35.006018 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:35.005801 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:30:35.006018 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:35.005839 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls podName:c2d5e55e-1604-4d52-bda6-9a32b996b339 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:36.005828755 +0000 UTC m=+179.153769901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8fbp" (UID: "c2d5e55e-1604-4d52-bda6-9a32b996b339") : secret "insights-runtime-extractor-tls" not found Jun 11 21:30:36.014946 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:36.014904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:36.015356 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:36.014993 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:36.015356 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:36.015067 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:30:36.015356 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:36.015123 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:30:36.015356 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:36.015132 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls podName:c2d5e55e-1604-4d52-bda6-9a32b996b339 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:38.015116232 +0000 UTC m=+181.163057364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8fbp" (UID: "c2d5e55e-1604-4d52-bda6-9a32b996b339") : secret "insights-runtime-extractor-tls" not found Jun 11 21:30:36.015356 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:36.015188 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm podName:c2d5e55e-1604-4d52-bda6-9a32b996b339 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:38.015170239 +0000 UTC m=+181.163111380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8fbp" (UID: "c2d5e55e-1604-4d52-bda6-9a32b996b339") : configmap "kube-rbac-proxy" not found Jun 11 21:30:36.226496 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:36.226471 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-965jb_a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23/dns-node-resolver/0.log" Jun 11 21:30:37.227486 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:37.227461 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bsx4x_d06fa857-a932-4daf-b686-a0e47fbc56cc/node-ca/0.log" Jun 11 21:30:37.628244 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:37.628213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:37.628396 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:37.628297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:37.628396 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:37.628363 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:37.628483 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:37.628427 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls podName:9c400a8c-ef0c-4525-9016-73a000d7f1ca nodeName:}" failed. No retries permitted until 2026-06-11 21:30:45.628409837 +0000 UTC m=+188.776350986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fcnkc" (UID: "9c400a8c-ef0c-4525-9016-73a000d7f1ca") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:37.628483 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:37.628426 2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 21:30:37.628483 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:37.628478 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls podName:77d64d6e-d1ba-4be7-9279-f79133ca9ee1 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:45.62846611 +0000 UTC m=+188.776407236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls") pod "cluster-samples-operator-9547488fd-dhmhv" (UID: "77d64d6e-d1ba-4be7-9279-f79133ca9ee1") : secret "samples-operator-tls" not found Jun 11 21:30:37.728857 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:37.728825 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:37.729000 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:37.728908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:37.729000 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:37.728981 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle podName:c172843b-7283-481f-a7b9-bb5378f186c6 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:45.728962999 +0000 UTC m=+188.876904126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle") pod "router-default-7bd9d485dd-lrv8r" (UID: "c172843b-7283-481f-a7b9-bb5378f186c6") : configmap references non-existent config key: service-ca.crt Jun 11 21:30:37.729081 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:37.729024 2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 21:30:37.729081 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:37.729067 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs podName:c172843b-7283-481f-a7b9-bb5378f186c6 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:45.729055359 +0000 UTC m=+188.876996503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs") pod "router-default-7bd9d485dd-lrv8r" (UID: "c172843b-7283-481f-a7b9-bb5378f186c6") : secret "router-metrics-certs-default" not found Jun 11 21:30:37.829986 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:37.829959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:37.830119 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:37.830103 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:30:37.830162 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:37.830122 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cbc68c555-pqhld: secret "image-registry-tls" not found Jun 11 21:30:37.830200 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:37.830165 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls podName:5ff5cb9e-70c4-47b1-a353-965e8f2c3c31 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:45.830152027 +0000 UTC m=+188.978093153 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls") pod "image-registry-6cbc68c555-pqhld" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31") : secret "image-registry-tls" not found Jun 11 21:30:38.032447 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:38.032414 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:38.032579 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:38.032510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:38.032579 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:38.032534 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:30:38.032677 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:38.032595 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm podName:c2d5e55e-1604-4d52-bda6-9a32b996b339 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:42.032578423 +0000 UTC m=+185.180519550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8fbp" (UID: "c2d5e55e-1604-4d52-bda6-9a32b996b339") : configmap "kube-rbac-proxy" not found Jun 11 21:30:38.032677 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:38.032621 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:30:38.032758 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:38.032682 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls podName:c2d5e55e-1604-4d52-bda6-9a32b996b339 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:42.032666875 +0000 UTC m=+185.180608033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8fbp" (UID: "c2d5e55e-1604-4d52-bda6-9a32b996b339") : secret "insights-runtime-extractor-tls" not found Jun 11 21:30:38.226824 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:38.226798 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4slm_26373a4a-7b9f-4023-bf1e-71e354fe85e4/serve-healthcheck-canary/0.log" Jun 11 21:30:42.065097 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:42.065064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:42.065463 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:42.065128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:42.065463 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:42.065209 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:30:42.065463 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:42.065222 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:30:42.065463 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:42.065270 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls podName:c2d5e55e-1604-4d52-bda6-9a32b996b339 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:50.065253418 +0000 UTC m=+193.213194546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8fbp" (UID: "c2d5e55e-1604-4d52-bda6-9a32b996b339") : secret "insights-runtime-extractor-tls" not found Jun 11 21:30:42.065463 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:42.065284 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm podName:c2d5e55e-1604-4d52-bda6-9a32b996b339 nodeName:}" failed. No retries permitted until 2026-06-11 21:30:50.065277954 +0000 UTC m=+193.213219081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8fbp" (UID: "c2d5e55e-1604-4d52-bda6-9a32b996b339") : configmap "kube-rbac-proxy" not found Jun 11 21:30:45.695126 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.695093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:30:45.695495 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.695160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:45.695495 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:45.695235 2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:45.695495 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:30:45.695293 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls podName:9c400a8c-ef0c-4525-9016-73a000d7f1ca nodeName:}" failed. No retries permitted until 2026-06-11 21:31:01.695278719 +0000 UTC m=+204.843219846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-fcnkc" (UID: "9c400a8c-ef0c-4525-9016-73a000d7f1ca") : secret "cluster-monitoring-operator-tls" not found Jun 11 21:30:45.697409 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.697385 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/77d64d6e-d1ba-4be7-9279-f79133ca9ee1-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-dhmhv\" (UID: \"77d64d6e-d1ba-4be7-9279-f79133ca9ee1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:45.795844 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.795806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:45.796016 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.795887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:45.796427 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.796392 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c172843b-7283-481f-a7b9-bb5378f186c6-service-ca-bundle\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:45.798138 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.798116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c172843b-7283-481f-a7b9-bb5378f186c6-metrics-certs\") pod \"router-default-7bd9d485dd-lrv8r\" (UID: \"c172843b-7283-481f-a7b9-bb5378f186c6\") " pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:45.805539 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.805521 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jm94q\"" Jun 11 21:30:45.812980 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.812962 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" Jun 11 21:30:45.893907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.893885 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gpx6n\"" Jun 11 21:30:45.896343 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.896324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:45.898772 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.898749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls\") pod \"image-registry-6cbc68c555-pqhld\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:45.902614 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.901940 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:45.932034 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.932002 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv"] Jun 11 21:30:45.995039 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.995015 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wm67l\"" Jun 11 21:30:45.999191 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:45.999171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:46.030257 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:46.030233 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bd9d485dd-lrv8r"] Jun 11 21:30:46.032158 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:30:46.032121 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc172843b_7283_481f_a7b9_bb5378f186c6.slice/crio-14f21ad7063b4b6c5e459decbcccd62317159e04ab8922d2b965824f252255ac WatchSource:0}: Error finding container 14f21ad7063b4b6c5e459decbcccd62317159e04ab8922d2b965824f252255ac: Status 404 returned error can't find the container with id 14f21ad7063b4b6c5e459decbcccd62317159e04ab8922d2b965824f252255ac Jun 11 21:30:46.124434 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:46.124410 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cbc68c555-pqhld"] Jun 11 21:30:46.126560 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:30:46.126529 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff5cb9e_70c4_47b1_a353_965e8f2c3c31.slice/crio-26da18994126645c964e5b81f79ace8c51ebc4c8e6a03319e42198288399ac22 WatchSource:0}: Error finding container 26da18994126645c964e5b81f79ace8c51ebc4c8e6a03319e42198288399ac22: Status 404 returned error can't find the container with id 26da18994126645c964e5b81f79ace8c51ebc4c8e6a03319e42198288399ac22 Jun 11 21:30:46.918233 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:46.918201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" event={"ID":"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31","Type":"ContainerStarted","Data":"c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e"} Jun 11 21:30:46.918686 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:46.918246 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" event={"ID":"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31","Type":"ContainerStarted","Data":"26da18994126645c964e5b81f79ace8c51ebc4c8e6a03319e42198288399ac22"} Jun 11 21:30:46.918686 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:46.918290 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:30:46.919681 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:46.919660 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" event={"ID":"c172843b-7283-481f-a7b9-bb5378f186c6","Type":"ContainerStarted","Data":"1bf9da905a0f7e273b4868603017c47ddc83ae8f9d31b934ce931185cdcd8130"} Jun 11 21:30:46.919750 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:46.919696 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" event={"ID":"c172843b-7283-481f-a7b9-bb5378f186c6","Type":"ContainerStarted","Data":"14f21ad7063b4b6c5e459decbcccd62317159e04ab8922d2b965824f252255ac"} Jun 11 21:30:46.920613 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:46.920596 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" event={"ID":"77d64d6e-d1ba-4be7-9279-f79133ca9ee1","Type":"ContainerStarted","Data":"7b250a581f9626df2a9f6d198032c5cb9b8510d75af16f965280852ba0b3fe77"} Jun 11 21:30:46.937595 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:46.937546 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" podStartSLOduration=16.937531918 podStartE2EDuration="16.937531918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:30:46.936241755 +0000 UTC m=+190.084182929" watchObservedRunningTime="2026-06-11 21:30:46.937531918 +0000 UTC m=+190.085473061" Jun 11 21:30:46.956671 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:46.954417 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" podStartSLOduration=17.954401671 podStartE2EDuration="17.954401671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:30:46.952510382 +0000 UTC m=+190.100451533" watchObservedRunningTime="2026-06-11 21:30:46.954401671 +0000 UTC m=+190.102342821" Jun 11 21:30:47.903107 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:47.903082 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:47.905412 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:47.905393 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:47.927230 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:47.927195 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" event={"ID":"77d64d6e-d1ba-4be7-9279-f79133ca9ee1","Type":"ContainerStarted","Data":"ea76082557125cba2eeee120ee7c30d6fd38a8d4b340c9723c30b842f26c0e18"} Jun 11 21:30:47.927617 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:47.927258 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" event={"ID":"77d64d6e-d1ba-4be7-9279-f79133ca9ee1","Type":"ContainerStarted","Data":"6917f127c1361067180fe88818e60909f5b5bb260a1e85ebbaf55e309335cf57"} Jun 11 21:30:47.927617 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:47.927534 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:47.928461 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:47.928441 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7bd9d485dd-lrv8r" Jun 11 21:30:47.949607 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:47.949567 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-dhmhv" podStartSLOduration=17.167740399 podStartE2EDuration="18.949555309s" totalImagesPullingTime="1.78181491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:30:47.948090136 +0000 UTC m=+191.096031288" watchObservedRunningTime="2026-06-11 21:30:47.949555309 +0000 UTC m=+191.097496458" Jun 11 21:30:50.130340 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:50.130306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:50.130858 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:50.130545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:50.130974 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:50.130939 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2d5e55e-1604-4d52-bda6-9a32b996b339-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:50.132808 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:50.132791 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2d5e55e-1604-4d52-bda6-9a32b996b339-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8fbp\" (UID: \"c2d5e55e-1604-4d52-bda6-9a32b996b339\") " pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:50.153682 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:50.153660 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-879w8\"" Jun 11 21:30:50.161211 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:50.161177 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l8fbp" Jun 11 21:30:50.280495 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:50.280464 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l8fbp"] Jun 11 21:30:50.284786 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:30:50.284745 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2d5e55e_1604_4d52_bda6_9a32b996b339.slice/crio-2346d619b20be26d1dc1308b2f33f05ed9e62e65fb358c6eb969075685ec633d WatchSource:0}: Error finding container 2346d619b20be26d1dc1308b2f33f05ed9e62e65fb358c6eb969075685ec633d: Status 404 returned error can't find the container with id 2346d619b20be26d1dc1308b2f33f05ed9e62e65fb358c6eb969075685ec633d Jun 11 21:30:50.938329 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:50.938289 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8fbp" event={"ID":"c2d5e55e-1604-4d52-bda6-9a32b996b339","Type":"ContainerStarted","Data":"2346d619b20be26d1dc1308b2f33f05ed9e62e65fb358c6eb969075685ec633d"} Jun 11 21:30:54.951371 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:54.951330 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8fbp" event={"ID":"c2d5e55e-1604-4d52-bda6-9a32b996b339","Type":"ContainerStarted","Data":"acbb31c4064560c0ed396a2de94fa5a97812197115a3eee582be871de6ec01b2"} Jun 11 21:30:54.951749 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:54.951394 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8fbp" event={"ID":"c2d5e55e-1604-4d52-bda6-9a32b996b339","Type":"ContainerStarted","Data":"5c925352459ca463aff87de102468d57041e91e9bf938dbb6b45e69a873d1590"} Jun 11 21:30:56.959513 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:56.959469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8fbp" event={"ID":"c2d5e55e-1604-4d52-bda6-9a32b996b339","Type":"ContainerStarted","Data":"6134d4b94e0d5d4a44888f78526c67e4d0afa61dd59f3c31c22e51ac14524fc0"} Jun 11 21:30:56.977751 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:56.977687 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l8fbp" podStartSLOduration=16.542861606 podStartE2EDuration="22.977666436s" totalImagesPullingTime="6.43480483s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:30:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:30:56.976802518 +0000 UTC m=+200.124743731" watchObservedRunningTime="2026-06-11 21:30:56.977666436 +0000 UTC m=+200.125607578" Jun 11 21:30:58.093362 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:30:58.093329 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cbc68c555-pqhld"] Jun 11 21:31:00.879398 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.879364 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9bcbfd55b-4bt7w"] Jun 11 21:31:00.888268 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.888246 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:00.891361 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.891338 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 21:31:00.892672 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.892605 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 21:31:00.892672 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.892627 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 21:31:00.892836 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.892727 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 21:31:00.892964 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.892943 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 21:31:00.893065 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.893031 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vs5mb\"" Jun 11 21:31:00.893065 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.893056 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 21:31:00.893459 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.893442 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 21:31:00.894948 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.894926 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9bcbfd55b-4bt7w"] Jun 11 21:31:00.898300 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.898280 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 21:31:00.912456 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.912434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-oauth-serving-cert\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:00.912535 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.912478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-trusted-ca-bundle\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:00.912535 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.912506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-console-config\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:00.912606 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.912550 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-oauth-config\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:00.912606 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.912574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-serving-cert\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:00.912606 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.912596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrj5d\" (UniqueName: \"kubernetes.io/projected/49c588f4-35c1-4515-8bfd-addad7a0799c-kube-api-access-wrj5d\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:00.912717 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:00.912612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-service-ca\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.013267 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.013244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-trusted-ca-bundle\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.013407 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.013278 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-console-config\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.013407 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.013302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-oauth-config\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.013407 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.013328 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-serving-cert\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.013407 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.013351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrj5d\" (UniqueName: \"kubernetes.io/projected/49c588f4-35c1-4515-8bfd-addad7a0799c-kube-api-access-wrj5d\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.013407 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.013375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-service-ca\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.013686 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.013521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-oauth-serving-cert\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.014162 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.014138 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-console-config\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.014162 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.014153 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-service-ca\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.014291 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.014204 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-oauth-serving-cert\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.014689 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.014668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-trusted-ca-bundle\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.015980 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.015956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-serving-cert\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.016094 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.016068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-oauth-config\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.021841 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.021820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrj5d\" (UniqueName: \"kubernetes.io/projected/49c588f4-35c1-4515-8bfd-addad7a0799c-kube-api-access-wrj5d\") pod \"console-9bcbfd55b-4bt7w\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.198946 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.198868 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:01.322076 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.322038 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9bcbfd55b-4bt7w"] Jun 11 21:31:01.326458 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:31:01.326433 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c588f4_35c1_4515_8bfd_addad7a0799c.slice/crio-e78c01f820642af6412d13196f5d20bda3f65eef35862010ce2cec2537be6ce3 WatchSource:0}: Error finding container e78c01f820642af6412d13196f5d20bda3f65eef35862010ce2cec2537be6ce3: Status 404 returned error can't find the container with id e78c01f820642af6412d13196f5d20bda3f65eef35862010ce2cec2537be6ce3 Jun 11 21:31:01.720438 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.720397 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:31:01.722733 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.722707 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9c400a8c-ef0c-4525-9016-73a000d7f1ca-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-fcnkc\" (UID: \"9c400a8c-ef0c-4525-9016-73a000d7f1ca\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:31:01.975887 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.975792 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bcbfd55b-4bt7w" event={"ID":"49c588f4-35c1-4515-8bfd-addad7a0799c","Type":"ContainerStarted","Data":"e78c01f820642af6412d13196f5d20bda3f65eef35862010ce2cec2537be6ce3"} Jun 11 21:31:01.999050 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:01.999020 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-p5fv5\"" Jun 11 21:31:02.006700 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:02.006675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" Jun 11 21:31:02.129208 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:02.129102 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc"] Jun 11 21:31:02.131513 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:31:02.131485 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c400a8c_ef0c_4525_9016_73a000d7f1ca.slice/crio-23814029258c552c624c80f360cfb787aabfbc29ed9a7c402f0ed8997156d2e3 WatchSource:0}: Error finding container 23814029258c552c624c80f360cfb787aabfbc29ed9a7c402f0ed8997156d2e3: Status 404 returned error can't find the container with id 23814029258c552c624c80f360cfb787aabfbc29ed9a7c402f0ed8997156d2e3 Jun 11 21:31:02.980565 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:02.980512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" event={"ID":"9c400a8c-ef0c-4525-9016-73a000d7f1ca","Type":"ContainerStarted","Data":"23814029258c552c624c80f360cfb787aabfbc29ed9a7c402f0ed8997156d2e3"} Jun 11 21:31:05.991028 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:05.990993 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bcbfd55b-4bt7w" event={"ID":"49c588f4-35c1-4515-8bfd-addad7a0799c","Type":"ContainerStarted","Data":"d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056"} Jun 11 21:31:05.992331 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:05.992299 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" event={"ID":"9c400a8c-ef0c-4525-9016-73a000d7f1ca","Type":"ContainerStarted","Data":"5223026a12699cded7d60389c3ee0170aded9fb2de61fd1f112df98aef147995"} Jun 11 21:31:06.009087 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:06.009033 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9bcbfd55b-4bt7w" podStartSLOduration=2.332256768 podStartE2EDuration="6.009019715s" totalImagesPullingTime="3.676762947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:06.007823165 +0000 UTC m=+209.155764314" watchObservedRunningTime="2026-06-11 21:31:06.009019715 +0000 UTC m=+209.156960916" Jun 11 21:31:06.023306 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:06.023264 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-fcnkc" podStartSLOduration=34.154920533 podStartE2EDuration="37.02325106s" totalImagesPullingTime="2.868330527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:06.022792954 +0000 UTC m=+209.170734104" watchObservedRunningTime="2026-06-11 21:31:06.02325106 +0000 UTC m=+209.171192209" Jun 11 21:31:08.098342 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:08.098309 2578 patch_prober.go:28] interesting pod/image-registry-6cbc68c555-pqhld container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:31:08.098709 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:08.098363 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" podUID="5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:31:11.199298 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:11.199260 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:11.199725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:11.199314 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:31:11.200684 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:11.200643 2578 patch_prober.go:28] interesting pod/console-9bcbfd55b-4bt7w container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 11 21:31:11.200793 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:11.200704 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9bcbfd55b-4bt7w" podUID="49c588f4-35c1-4515-8bfd-addad7a0799c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 11 21:31:18.097398 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:18.097364 2578 patch_prober.go:28] interesting pod/image-registry-6cbc68c555-pqhld container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:31:18.097776 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:18.097421 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" podUID="5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:31:19.907200 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.907165 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb"] Jun 11 21:31:19.909663 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.909633 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n22ft"] Jun 11 21:31:19.909777 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.909731 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:19.911993 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.911975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:19.912826 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.912806 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 21:31:19.912922 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.912875 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pj5jh\"" Jun 11 21:31:19.912922 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.912879 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 21:31:19.913859 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.913842 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 21:31:19.913934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.913845 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 21:31:19.914354 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.914341 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 21:31:19.914742 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.914724 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l2xhl\"" Jun 11 21:31:19.914806 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.914739 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 21:31:19.914806 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.914776 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 21:31:19.923311 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.923286 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb"] Jun 11 21:31:19.969946 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.969923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-metrics-client-ca\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:19.970050 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.969953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-textfile\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:19.970050 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.969973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-wtmp\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:19.970050 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.969999 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85vw\" (UniqueName: \"kubernetes.io/projected/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-kube-api-access-v85vw\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:19.970050 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:19.970181 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:19.970181 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970119 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d59257b-de44-48b0-b41d-13b50732b521-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:19.970181 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4bg5\" (UniqueName: \"kubernetes.io/projected/3d59257b-de44-48b0-b41d-13b50732b521-kube-api-access-m4bg5\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:19.970181 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970169 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:19.970304 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:19.970304 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-accelerators-collector-config\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:19.970304 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970246 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-sys\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:19.970304 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-root\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:19.970304 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d59257b-de44-48b0-b41d-13b50732b521-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:19.970454 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:19.970306 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-tls\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.071391 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.071506 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071406 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.071506 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071430 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d59257b-de44-48b0-b41d-13b50732b521-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.071506 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4bg5\" (UniqueName: \"kubernetes.io/projected/3d59257b-de44-48b0-b41d-13b50732b521-kube-api-access-m4bg5\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.071506 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.071733 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.071733 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-accelerators-collector-config\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.071733 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-sys\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.071733 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-root\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.071733 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:31:20.071668 2578 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 11 21:31:20.071733 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:31:20.071735 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-tls podName:3d59257b-de44-48b0-b41d-13b50732b521 nodeName:}" failed. No retries permitted until 2026-06-11 21:31:20.571715494 +0000 UTC m=+223.719656621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-h2bbb" (UID: "3d59257b-de44-48b0-b41d-13b50732b521") : secret "kube-state-metrics-tls" not found Jun 11 21:31:20.072019 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071670 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d59257b-de44-48b0-b41d-13b50732b521-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.072019 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-tls\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.072019 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-metrics-client-ca\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.072019 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071945 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-textfile\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.072019 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-wtmp\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.072019 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.071996 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-sys\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.072286 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.072039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v85vw\" (UniqueName: \"kubernetes.io/projected/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-kube-api-access-v85vw\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.072286 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.072124 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-wtmp\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.072396 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.072337 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-root\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.072396 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.072338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d59257b-de44-48b0-b41d-13b50732b521-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.072508 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.072393 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.072607 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.072581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-textfile\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.072752 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.072661 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/3d59257b-de44-48b0-b41d-13b50732b521-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.072820 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.072806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-metrics-client-ca\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.072876 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.072806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-accelerators-collector-config\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.074001 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.073972 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.074128 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.074112 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-node-exporter-tls\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.074178 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.074137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.080281 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.080259 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85vw\" (UniqueName: \"kubernetes.io/projected/cb731c62-5d8c-40c3-989c-5f4cf5f09a6e-kube-api-access-v85vw\") pod \"node-exporter-n22ft\" (UID: \"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e\") " pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.080375 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.080355 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4bg5\" (UniqueName: \"kubernetes.io/projected/3d59257b-de44-48b0-b41d-13b50732b521-kube-api-access-m4bg5\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.229219 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.229137 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n22ft" Jun 11 21:31:20.238928 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:31:20.238903 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb731c62_5d8c_40c3_989c_5f4cf5f09a6e.slice/crio-35ce75a91a44f179e9e9eee64e87e9dcc22c07fcfd1b5284015109b622218b23 WatchSource:0}: Error finding container 35ce75a91a44f179e9e9eee64e87e9dcc22c07fcfd1b5284015109b622218b23: Status 404 returned error can't find the container with id 35ce75a91a44f179e9e9eee64e87e9dcc22c07fcfd1b5284015109b622218b23 Jun 11 21:31:20.577620 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.577589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.580038 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.580015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d59257b-de44-48b0-b41d-13b50732b521-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-h2bbb\" (UID: \"3d59257b-de44-48b0-b41d-13b50732b521\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.823663 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.823595 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" Jun 11 21:31:20.969617 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:20.969591 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb"] Jun 11 21:31:21.041635 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:21.041594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n22ft" event={"ID":"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e","Type":"ContainerStarted","Data":"35ce75a91a44f179e9e9eee64e87e9dcc22c07fcfd1b5284015109b622218b23"} Jun 11 21:31:21.111266 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:31:21.111193 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d59257b_de44_48b0_b41d_13b50732b521.slice/crio-a10cdff02421a57d9ab27475aafaacf402e142d82bd9aa3d83461ef7f55146d0 WatchSource:0}: Error finding container a10cdff02421a57d9ab27475aafaacf402e142d82bd9aa3d83461ef7f55146d0: Status 404 returned error can't find the container with id a10cdff02421a57d9ab27475aafaacf402e142d82bd9aa3d83461ef7f55146d0 Jun 11 21:31:21.199637 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:21.199611 2578 patch_prober.go:28] interesting pod/console-9bcbfd55b-4bt7w container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 11 21:31:21.199749 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:21.199667 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9bcbfd55b-4bt7w" podUID="49c588f4-35c1-4515-8bfd-addad7a0799c" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 11 21:31:22.048044 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.048005 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" event={"ID":"3d59257b-de44-48b0-b41d-13b50732b521","Type":"ContainerStarted","Data":"a10cdff02421a57d9ab27475aafaacf402e142d82bd9aa3d83461ef7f55146d0"} Jun 11 21:31:22.049900 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.049856 2578 generic.go:356] "Generic (PLEG): container finished" podID="cb731c62-5d8c-40c3-989c-5f4cf5f09a6e" containerID="14966340a2a1e08885f9252e048bcfd0e66578151de13dce0f1ac233170d4868" exitCode=0 Jun 11 21:31:22.050049 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.049915 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n22ft" event={"ID":"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e","Type":"ContainerDied","Data":"14966340a2a1e08885f9252e048bcfd0e66578151de13dce0f1ac233170d4868"} Jun 11 21:31:22.882388 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.882346 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8"] Jun 11 21:31:22.885054 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.885038 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:22.888022 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.887970 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 21:31:22.888022 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.888010 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 21:31:22.888347 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.888331 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 21:31:22.888432 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.888415 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-epjttsls91bh2\"" Jun 11 21:31:22.888489 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.888458 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 21:31:22.889478 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.889457 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-5ctpc\"" Jun 11 21:31:22.889704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.889688 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 21:31:22.898344 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.898322 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8"] Jun 11 21:31:22.997828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.997796 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:22.998013 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.997841 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:22.998013 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.997859 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-grpc-tls\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:22.998013 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.997974 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-metrics-client-ca\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:22.998013 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.998011 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-tls\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:22.998205 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.998089 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd9bp\" (UniqueName: \"kubernetes.io/projected/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-kube-api-access-gd9bp\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:22.998205 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.998126 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:22.998205 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:22.998163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.055901 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.055873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n22ft" event={"ID":"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e","Type":"ContainerStarted","Data":"2b0ceeedd263601072508125004a3dff2d9177d0275b6cbcb8587878142b8472"} Jun 11 21:31:23.056289 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.055961 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n22ft" event={"ID":"cb731c62-5d8c-40c3-989c-5f4cf5f09a6e","Type":"ContainerStarted","Data":"7a149ab366024baee1d62cfdc57f1883e038b9cffb57bf9a7c4ed95169ec8111"} Jun 11 21:31:23.060757 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.060735 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" event={"ID":"3d59257b-de44-48b0-b41d-13b50732b521","Type":"ContainerStarted","Data":"f832c20cb1c00e27b4db836b4c8098a923d14f3b4b72aa5014746d933ee4df50"} Jun 11 21:31:23.060867 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.060777 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" event={"ID":"3d59257b-de44-48b0-b41d-13b50732b521","Type":"ContainerStarted","Data":"5fdb15a3e5c1e6e59c9453ce6134860542a6749e7f37ddf54f99387988cb077d"} Jun 11 21:31:23.060867 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.060795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" event={"ID":"3d59257b-de44-48b0-b41d-13b50732b521","Type":"ContainerStarted","Data":"6d66cc293520630a503ed7b8afcd7691c02a17048df67c08fc1980d775dce88e"} Jun 11 21:31:23.075092 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.075048 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n22ft" podStartSLOduration=3.11561591 podStartE2EDuration="4.075034196s" totalImagesPullingTime="894.878514ms" totalInitContainerRuntime="64.539772ms" isStatefulPod=true podCreationTimestamp="2026-06-11 21:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:23.074347992 +0000 UTC m=+226.222289141" watchObservedRunningTime="2026-06-11 21:31:23.075034196 +0000 UTC m=+226.222975344" Jun 11 21:31:23.091828 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.091790 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-h2bbb" podStartSLOduration=2.811169683 podStartE2EDuration="4.091778106s" totalImagesPullingTime="1.280608423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:23.091021195 +0000 UTC m=+226.238962345" watchObservedRunningTime="2026-06-11 21:31:23.091778106 +0000 UTC m=+226.239719254" Jun 11 21:31:23.098542 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.098522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-metrics-client-ca\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.098671 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.098552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-tls\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.098671 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.098575 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd9bp\" (UniqueName: \"kubernetes.io/projected/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-kube-api-access-gd9bp\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.098671 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.098599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.098671 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.098664 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.098876 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.098705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.098876 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.098751 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.098876 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.098775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-grpc-tls\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.099388 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.099362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-metrics-client-ca\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.101341 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.101321 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-tls\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.101496 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.101473 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-grpc-tls\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.101545 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.101532 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.101607 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.101591 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.101669 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.101598 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.101710 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.101678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.105958 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.105940 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd9bp\" (UniqueName: \"kubernetes.io/projected/ba0102a6-45e9-4f47-b5dc-b1113b7924bc-kube-api-access-gd9bp\") pod \"thanos-querier-6cc5ccdfb6-ct8s8\" (UID: \"ba0102a6-45e9-4f47-b5dc-b1113b7924bc\") " pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.113330 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.113284 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" podUID="5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" containerName="registry" containerID="cri-o://c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e" gracePeriod=30 Jun 11 21:31:23.194565 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.194496 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:23.355178 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.355156 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:31:23.502039 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.501955 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-bound-sa-token\") pod \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " Jun 11 21:31:23.502039 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.502012 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcs4z\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-kube-api-access-kcs4z\") pod \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " Jun 11 21:31:23.502222 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.502056 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-trusted-ca\") pod \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " Jun 11 21:31:23.502222 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.502167 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls\") pod \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " Jun 11 21:31:23.502321 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.502246 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-installation-pull-secrets\") pod \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " Jun 11 21:31:23.502321 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.502275 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-certificates\") pod \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " Jun 11 21:31:23.502321 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.502299 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-image-registry-private-configuration\") pod \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " Jun 11 21:31:23.502484 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.502330 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-ca-trust-extracted\") pod \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\" (UID: \"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31\") " Jun 11 21:31:23.502484 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.502467 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:31:23.502806 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.502783 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-trusted-ca\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:31:23.502991 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.502820 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:31:23.504756 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.504608 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:31:23.504756 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.504704 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:31:23.504905 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.504755 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:31:23.504905 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.504762 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:31:23.504905 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.504872 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-kube-api-access-kcs4z" (OuterVolumeSpecName: "kube-api-access-kcs4z") pod "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31"). InnerVolumeSpecName "kube-api-access-kcs4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:31:23.523661 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.523586 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" (UID: "5ff5cb9e-70c4-47b1-a353-965e8f2c3c31"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:31:23.541608 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.541584 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8"] Jun 11 21:31:23.543208 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:31:23.543185 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba0102a6_45e9_4f47_b5dc_b1113b7924bc.slice/crio-d38dc1f9df2ad8007dc6383ecf50b0c4fc1412c32286f9cf980516e00cd7552b WatchSource:0}: Error finding container d38dc1f9df2ad8007dc6383ecf50b0c4fc1412c32286f9cf980516e00cd7552b: Status 404 returned error can't find the container with id d38dc1f9df2ad8007dc6383ecf50b0c4fc1412c32286f9cf980516e00cd7552b Jun 11 21:31:23.604124 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.604102 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-installation-pull-secrets\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:31:23.604124 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.604121 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-certificates\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:31:23.604273 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.604132 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-image-registry-private-configuration\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:31:23.604273 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.604142 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-ca-trust-extracted\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:31:23.604273 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.604152 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-bound-sa-token\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:31:23.604273 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.604161 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcs4z\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-kube-api-access-kcs4z\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:31:23.604273 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:23.604169 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31-registry-tls\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:31:24.066186 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.066151 2578 generic.go:356] "Generic (PLEG): container finished" podID="5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" containerID="c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e" exitCode=0 Jun 11 21:31:24.066639 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.066203 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" Jun 11 21:31:24.066639 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.066238 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" event={"ID":"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31","Type":"ContainerDied","Data":"c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e"} Jun 11 21:31:24.066639 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.066299 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cbc68c555-pqhld" event={"ID":"5ff5cb9e-70c4-47b1-a353-965e8f2c3c31","Type":"ContainerDied","Data":"26da18994126645c964e5b81f79ace8c51ebc4c8e6a03319e42198288399ac22"} Jun 11 21:31:24.066639 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.066329 2578 scope.go:117] "RemoveContainer" containerID="c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e" Jun 11 21:31:24.067733 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.067630 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" event={"ID":"ba0102a6-45e9-4f47-b5dc-b1113b7924bc","Type":"ContainerStarted","Data":"d38dc1f9df2ad8007dc6383ecf50b0c4fc1412c32286f9cf980516e00cd7552b"} Jun 11 21:31:24.075905 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.075795 2578 scope.go:117] "RemoveContainer" containerID="c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e" Jun 11 21:31:24.076634 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:31:24.076607 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e\": container with ID starting with c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e not found: ID does not exist" containerID="c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e" Jun 11 21:31:24.076749 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.076663 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e"} err="failed to get container status \"c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e\": rpc error: code = NotFound desc = could not find container \"c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e\": container with ID starting with c5499097dfc9e8cabcc4257537bab412c306686338792a099913db0fe9e8ac0e not found: ID does not exist" Jun 11 21:31:24.092597 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.092572 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cbc68c555-pqhld"] Jun 11 21:31:24.098103 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.098081 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cbc68c555-pqhld"] Jun 11 21:31:24.193854 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.193827 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7776c7cb6f-pdnhk"] Jun 11 21:31:24.194094 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.194082 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" containerName="registry" Jun 11 21:31:24.194094 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.194095 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" containerName="registry" Jun 11 21:31:24.194172 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.194149 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" containerName="registry" Jun 11 21:31:24.196550 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.196533 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.199599 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.199579 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 21:31:24.199823 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.199805 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 21:31:24.199898 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.199861 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 21:31:24.199953 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.199906 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vjg74\"" Jun 11 21:31:24.199953 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.199917 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c7so2upcsppvu\"" Jun 11 21:31:24.200137 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.200124 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 21:31:24.207049 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.207030 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7776c7cb6f-pdnhk"] Jun 11 21:31:24.310845 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.310813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8227700d-9984-4afd-9c05-43986a9b3968-metrics-server-audit-profiles\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.310990 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.310862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8227700d-9984-4afd-9c05-43986a9b3968-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.310990 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.310930 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8227700d-9984-4afd-9c05-43986a9b3968-secret-metrics-server-client-certs\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.310990 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.310971 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dztz9\" (UniqueName: \"kubernetes.io/projected/8227700d-9984-4afd-9c05-43986a9b3968-kube-api-access-dztz9\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.311222 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.311031 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8227700d-9984-4afd-9c05-43986a9b3968-secret-metrics-server-tls\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.311222 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.311118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8227700d-9984-4afd-9c05-43986a9b3968-audit-log\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.311222 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.311145 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8227700d-9984-4afd-9c05-43986a9b3968-client-ca-bundle\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.412294 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.412213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8227700d-9984-4afd-9c05-43986a9b3968-client-ca-bundle\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.412294 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.412285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8227700d-9984-4afd-9c05-43986a9b3968-metrics-server-audit-profiles\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.412495 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.412331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8227700d-9984-4afd-9c05-43986a9b3968-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.412495 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.412370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8227700d-9984-4afd-9c05-43986a9b3968-secret-metrics-server-client-certs\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.412495 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.412420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dztz9\" (UniqueName: \"kubernetes.io/projected/8227700d-9984-4afd-9c05-43986a9b3968-kube-api-access-dztz9\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.412495 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.412474 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8227700d-9984-4afd-9c05-43986a9b3968-secret-metrics-server-tls\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.412720 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.412541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8227700d-9984-4afd-9c05-43986a9b3968-audit-log\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.413355 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.413225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8227700d-9984-4afd-9c05-43986a9b3968-audit-log\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.413790 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.413708 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8227700d-9984-4afd-9c05-43986a9b3968-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.413897 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.413805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8227700d-9984-4afd-9c05-43986a9b3968-metrics-server-audit-profiles\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.415115 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.415090 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8227700d-9984-4afd-9c05-43986a9b3968-client-ca-bundle\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.415416 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.415395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8227700d-9984-4afd-9c05-43986a9b3968-secret-metrics-server-tls\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.415519 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.415397 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8227700d-9984-4afd-9c05-43986a9b3968-secret-metrics-server-client-certs\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.422675 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.422621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dztz9\" (UniqueName: \"kubernetes.io/projected/8227700d-9984-4afd-9c05-43986a9b3968-kube-api-access-dztz9\") pod \"metrics-server-7776c7cb6f-pdnhk\" (UID: \"8227700d-9984-4afd-9c05-43986a9b3968\") " pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.506001 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.505971 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:24.637015 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.636992 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7776c7cb6f-pdnhk"] Jun 11 21:31:24.639418 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:31:24.639393 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8227700d_9984_4afd_9c05_43986a9b3968.slice/crio-1e8e194cb8605f6f6b208fc127d157d469d9c8c7b90b4e00c9bf38d9894dcd09 WatchSource:0}: Error finding container 1e8e194cb8605f6f6b208fc127d157d469d9c8c7b90b4e00c9bf38d9894dcd09: Status 404 returned error can't find the container with id 1e8e194cb8605f6f6b208fc127d157d469d9c8c7b90b4e00c9bf38d9894dcd09 Jun 11 21:31:24.691201 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.691137 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr"] Jun 11 21:31:24.693835 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.693817 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:24.696743 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.696674 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 21:31:24.696743 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.696707 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7hhv6\"" Jun 11 21:31:24.703467 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.703445 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr"] Jun 11 21:31:24.733045 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.733016 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55b95c46-fhls4"] Jun 11 21:31:24.735000 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.734984 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.746739 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.746720 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55b95c46-fhls4"] Jun 11 21:31:24.816341 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.816309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-serving-cert\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.816511 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.816353 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqlgv\" (UniqueName: \"kubernetes.io/projected/061f56fc-167c-40b4-b4cd-2fb63d818e8c-kube-api-access-mqlgv\") pod \"monitoring-plugin-589576dfc7-m6dbr\" (UID: \"061f56fc-167c-40b4-b4cd-2fb63d818e8c\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:24.816511 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.816390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92kqf\" (UniqueName: \"kubernetes.io/projected/e06283ba-f547-475c-9a71-37f3576dc93a-kube-api-access-92kqf\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.816511 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.816479 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-service-ca\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.816511 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.816503 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-console-config\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.816741 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.816559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-trusted-ca-bundle\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.816741 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.816581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-oauth-serving-cert\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.816741 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.816678 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/061f56fc-167c-40b4-b4cd-2fb63d818e8c-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-m6dbr\" (UID: \"061f56fc-167c-40b4-b4cd-2fb63d818e8c\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:24.816741 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.816708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-oauth-config\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.917015 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.916987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-oauth-config\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.917144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.917024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-serving-cert\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.917144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.917052 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqlgv\" (UniqueName: \"kubernetes.io/projected/061f56fc-167c-40b4-b4cd-2fb63d818e8c-kube-api-access-mqlgv\") pod \"monitoring-plugin-589576dfc7-m6dbr\" (UID: \"061f56fc-167c-40b4-b4cd-2fb63d818e8c\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:24.917144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.917077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92kqf\" (UniqueName: \"kubernetes.io/projected/e06283ba-f547-475c-9a71-37f3576dc93a-kube-api-access-92kqf\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.917144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.917116 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-service-ca\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.917679 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.917611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-console-config\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.917960 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.917725 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-trusted-ca-bundle\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.917960 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.917939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-oauth-serving-cert\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.922630 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.918153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/061f56fc-167c-40b4-b4cd-2fb63d818e8c-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-m6dbr\" (UID: \"061f56fc-167c-40b4-b4cd-2fb63d818e8c\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:24.922630 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.918225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-service-ca\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.922630 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.918763 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-console-config\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.922630 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.919458 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-oauth-serving-cert\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.922630 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:31:24.919544 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 11 21:31:24.922630 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:31:24.919630 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/061f56fc-167c-40b4-b4cd-2fb63d818e8c-monitoring-plugin-cert podName:061f56fc-167c-40b4-b4cd-2fb63d818e8c nodeName:}" failed. No retries permitted until 2026-06-11 21:31:25.419599706 +0000 UTC m=+228.567540857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/061f56fc-167c-40b4-b4cd-2fb63d818e8c-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-m6dbr" (UID: "061f56fc-167c-40b4-b4cd-2fb63d818e8c") : secret "monitoring-plugin-cert" not found Jun 11 21:31:24.922630 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.920677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-oauth-config\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.922630 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.920733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-serving-cert\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.923858 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.923840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-trusted-ca-bundle\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.927034 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.927013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92kqf\" (UniqueName: \"kubernetes.io/projected/e06283ba-f547-475c-9a71-37f3576dc93a-kube-api-access-92kqf\") pod \"console-55b95c46-fhls4\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:24.927100 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:24.927058 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqlgv\" (UniqueName: \"kubernetes.io/projected/061f56fc-167c-40b4-b4cd-2fb63d818e8c-kube-api-access-mqlgv\") pod \"monitoring-plugin-589576dfc7-m6dbr\" (UID: \"061f56fc-167c-40b4-b4cd-2fb63d818e8c\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:25.043491 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:25.043454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:25.077424 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:25.077377 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" event={"ID":"8227700d-9984-4afd-9c05-43986a9b3968","Type":"ContainerStarted","Data":"1e8e194cb8605f6f6b208fc127d157d469d9c8c7b90b4e00c9bf38d9894dcd09"} Jun 11 21:31:25.178433 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:25.178351 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55b95c46-fhls4"] Jun 11 21:31:25.181709 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:31:25.181680 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06283ba_f547_475c_9a71_37f3576dc93a.slice/crio-052fa417de960719432c6f23d7850fd1d04735ffaa78a0bc964bcf3a88873965 WatchSource:0}: Error finding container 052fa417de960719432c6f23d7850fd1d04735ffaa78a0bc964bcf3a88873965: Status 404 returned error can't find the container with id 052fa417de960719432c6f23d7850fd1d04735ffaa78a0bc964bcf3a88873965 Jun 11 21:31:25.339989 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:25.339914 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ff5cb9e-70c4-47b1-a353-965e8f2c3c31" path="/var/lib/kubelet/pods/5ff5cb9e-70c4-47b1-a353-965e8f2c3c31/volumes" Jun 11 21:31:25.424735 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:25.424636 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/061f56fc-167c-40b4-b4cd-2fb63d818e8c-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-m6dbr\" (UID: \"061f56fc-167c-40b4-b4cd-2fb63d818e8c\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:25.427727 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:25.427668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/061f56fc-167c-40b4-b4cd-2fb63d818e8c-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-m6dbr\" (UID: \"061f56fc-167c-40b4-b4cd-2fb63d818e8c\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:25.604240 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:25.604156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:26.083763 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:26.083725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b95c46-fhls4" event={"ID":"e06283ba-f547-475c-9a71-37f3576dc93a","Type":"ContainerStarted","Data":"9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04"} Jun 11 21:31:26.084160 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:26.083776 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b95c46-fhls4" event={"ID":"e06283ba-f547-475c-9a71-37f3576dc93a","Type":"ContainerStarted","Data":"052fa417de960719432c6f23d7850fd1d04735ffaa78a0bc964bcf3a88873965"} Jun 11 21:31:26.106266 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:26.106216 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55b95c46-fhls4" podStartSLOduration=2.106198276 podStartE2EDuration="2.106198276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:26.104491673 +0000 UTC m=+229.252432824" watchObservedRunningTime="2026-06-11 21:31:26.106198276 +0000 UTC m=+229.254139425" Jun 11 21:31:26.478301 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:26.478274 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr"] Jun 11 21:31:26.484139 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:31:26.484108 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061f56fc_167c_40b4_b4cd_2fb63d818e8c.slice/crio-216ea863bf51101119f9f812d5aa56a35e2dad1bd33a97f6ecfaba403980ebbe WatchSource:0}: Error finding container 216ea863bf51101119f9f812d5aa56a35e2dad1bd33a97f6ecfaba403980ebbe: Status 404 returned error can't find the container with id 216ea863bf51101119f9f812d5aa56a35e2dad1bd33a97f6ecfaba403980ebbe Jun 11 21:31:27.089395 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:27.089360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" event={"ID":"ba0102a6-45e9-4f47-b5dc-b1113b7924bc","Type":"ContainerStarted","Data":"e42eee298019adf8d568a62361ff98c78a2e05f9b7091d18a2fa1207e95b45bc"} Jun 11 21:31:27.089779 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:27.089428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" event={"ID":"ba0102a6-45e9-4f47-b5dc-b1113b7924bc","Type":"ContainerStarted","Data":"5b5a7304e79adf133f34056052ad8409e6531297ae393948cb5f4bc366e002e3"} Jun 11 21:31:27.089779 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:27.089469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" event={"ID":"ba0102a6-45e9-4f47-b5dc-b1113b7924bc","Type":"ContainerStarted","Data":"ce4646141a5babd3e67c4efbc391d97e9cf77045a0716c6964c9754cbd9010b3"} Jun 11 21:31:27.090529 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:27.090502 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" event={"ID":"061f56fc-167c-40b4-b4cd-2fb63d818e8c","Type":"ContainerStarted","Data":"216ea863bf51101119f9f812d5aa56a35e2dad1bd33a97f6ecfaba403980ebbe"} Jun 11 21:31:27.091981 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:27.091962 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" event={"ID":"8227700d-9984-4afd-9c05-43986a9b3968","Type":"ContainerStarted","Data":"f371c6aabc11cb4f62078964719548f68caf0544b3824707c3ec9ce99dd7b95c"} Jun 11 21:31:27.112936 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:27.112894 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" podStartSLOduration=1.396993889 podStartE2EDuration="3.112880629s" totalImagesPullingTime="1.71588674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:27.111349775 +0000 UTC m=+230.259290927" watchObservedRunningTime="2026-06-11 21:31:27.112880629 +0000 UTC m=+230.260821778" Jun 11 21:31:29.006311 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.006263 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9bcbfd55b-4bt7w"] Jun 11 21:31:29.037948 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.037919 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bbd85c69c-bk74t"] Jun 11 21:31:29.040451 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.040435 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.050069 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.050045 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bbd85c69c-bk74t"] Jun 11 21:31:29.102122 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.102092 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" event={"ID":"ba0102a6-45e9-4f47-b5dc-b1113b7924bc","Type":"ContainerStarted","Data":"85d8a773e4f86b432060fef64e139a56a0c3f0877382a976012287610888fade"} Jun 11 21:31:29.102253 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.102154 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" event={"ID":"ba0102a6-45e9-4f47-b5dc-b1113b7924bc","Type":"ContainerStarted","Data":"436ad3a2674cb4b347bc9ebd0bbf61874089d54224033de642fd0b85e78bd043"} Jun 11 21:31:29.102253 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.102182 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" event={"ID":"ba0102a6-45e9-4f47-b5dc-b1113b7924bc","Type":"ContainerStarted","Data":"04e825e5ab20b930157a633b3764146510e88f3cd76e341225e8b2863bde0a06"} Jun 11 21:31:29.102253 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.102226 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:29.103494 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.103462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" event={"ID":"061f56fc-167c-40b4-b4cd-2fb63d818e8c","Type":"ContainerStarted","Data":"eef9b0090943b54c4e20ec53c62d4cb105ba5e4bc1f47b5364a376fbba76fa0b"} Jun 11 21:31:29.103606 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.103515 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:29.108164 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.108144 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" Jun 11 21:31:29.124472 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.124434 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" podStartSLOduration=2.803529459 podStartE2EDuration="7.124421132s" totalImagesPullingTime="4.320891673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:29.123409266 +0000 UTC m=+232.271350419" watchObservedRunningTime="2026-06-11 21:31:29.124421132 +0000 UTC m=+232.272362282" Jun 11 21:31:29.142380 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.142338 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-m6dbr" podStartSLOduration=3.489195939 podStartE2EDuration="5.142326243s" totalImagesPullingTime="1.653130304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:29.14176069 +0000 UTC m=+232.289701839" watchObservedRunningTime="2026-06-11 21:31:29.142326243 +0000 UTC m=+232.290267392" Jun 11 21:31:29.162567 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.162535 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tdr5\" (UniqueName: \"kubernetes.io/projected/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-kube-api-access-5tdr5\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.162567 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.162572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-oauth-serving-cert\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.162783 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.162702 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-service-ca\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.162783 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.162744 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-config\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.162886 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.162814 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-serving-cert\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.162886 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.162839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-trusted-ca-bundle\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.162989 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.162898 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-oauth-config\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.264007 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.263966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-serving-cert\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.264197 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.264026 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-trusted-ca-bundle\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.264197 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.264170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-oauth-config\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.264314 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.264244 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tdr5\" (UniqueName: \"kubernetes.io/projected/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-kube-api-access-5tdr5\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.264314 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.264289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-oauth-serving-cert\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.264439 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.264420 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-service-ca\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.264495 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.264483 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-config\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.265159 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.265129 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-trusted-ca-bundle\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.265270 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.265189 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-oauth-serving-cert\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.265270 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.265246 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-service-ca\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.265438 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.265420 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-config\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.266974 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.266953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-oauth-config\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.267078 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.267065 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-serving-cert\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.272073 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.272051 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tdr5\" (UniqueName: \"kubernetes.io/projected/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-kube-api-access-5tdr5\") pod \"console-5bbd85c69c-bk74t\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.350033 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.350006 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:29.474768 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:29.474745 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bbd85c69c-bk74t"] Jun 11 21:31:29.476748 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:31:29.476709 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ea4229_c4bc_4419_bb30_d35a7b2fcfa0.slice/crio-cebea68eaa7a27f12fe2c63a41ad5b6567674749bb26c5e704434a0a98fb9c56 WatchSource:0}: Error finding container cebea68eaa7a27f12fe2c63a41ad5b6567674749bb26c5e704434a0a98fb9c56: Status 404 returned error can't find the container with id cebea68eaa7a27f12fe2c63a41ad5b6567674749bb26c5e704434a0a98fb9c56 Jun 11 21:31:30.108323 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:30.108286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbd85c69c-bk74t" event={"ID":"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0","Type":"ContainerStarted","Data":"92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db"} Jun 11 21:31:30.108752 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:30.108343 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbd85c69c-bk74t" event={"ID":"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0","Type":"ContainerStarted","Data":"cebea68eaa7a27f12fe2c63a41ad5b6567674749bb26c5e704434a0a98fb9c56"} Jun 11 21:31:30.128680 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:30.128627 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bbd85c69c-bk74t" podStartSLOduration=1.12861034 podStartE2EDuration="1.12861034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:30.125903818 +0000 UTC m=+233.273844967" watchObservedRunningTime="2026-06-11 21:31:30.12861034 +0000 UTC m=+233.276551488" Jun 11 21:31:35.043707 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:35.043668 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:35.044058 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:35.043737 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:31:35.045188 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:35.045166 2578 patch_prober.go:28] interesting pod/console-55b95c46-fhls4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 11 21:31:35.045255 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:35.045209 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-55b95c46-fhls4" podUID="e06283ba-f547-475c-9a71-37f3576dc93a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 11 21:31:35.114263 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:35.114239 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6cc5ccdfb6-ct8s8" Jun 11 21:31:39.142072 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:39.142039 2578 generic.go:356] "Generic (PLEG): container finished" podID="76228efd-e9f7-4877-a884-462c175462bd" containerID="9681802232ced823b17c76f2ed6af48343fb125c826f6181f2e130a21fbac6db" exitCode=0 Jun 11 21:31:39.142514 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:39.142095 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" event={"ID":"76228efd-e9f7-4877-a884-462c175462bd","Type":"ContainerDied","Data":"9681802232ced823b17c76f2ed6af48343fb125c826f6181f2e130a21fbac6db"} Jun 11 21:31:39.142514 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:39.142381 2578 scope.go:117] "RemoveContainer" containerID="9681802232ced823b17c76f2ed6af48343fb125c826f6181f2e130a21fbac6db" Jun 11 21:31:39.350247 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:39.350202 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:39.350439 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:39.350287 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:31:39.351401 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:39.351377 2578 patch_prober.go:28] interesting pod/console-5bbd85c69c-bk74t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 11 21:31:39.351515 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:39.351421 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bbd85c69c-bk74t" podUID="38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 11 21:31:40.147314 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:40.147283 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-8tk5t" event={"ID":"76228efd-e9f7-4877-a884-462c175462bd","Type":"ContainerStarted","Data":"9a242888d3874dc2f25fed6e9acd0c7ad4bb0370ffd9d2d342ed653ad365da8e"} Jun 11 21:31:43.643281 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:43.643249 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-fcnkc_9c400a8c-ef0c-4525-9016-73a000d7f1ca/cluster-monitoring-operator/0.log" Jun 11 21:31:43.841341 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:43.841311 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-h2bbb_3d59257b-de44-48b0-b41d-13b50732b521/kube-state-metrics/0.log" Jun 11 21:31:44.041607 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:44.041574 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-h2bbb_3d59257b-de44-48b0-b41d-13b50732b521/kube-rbac-proxy-main/0.log" Jun 11 21:31:44.241078 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:44.241052 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-h2bbb_3d59257b-de44-48b0-b41d-13b50732b521/kube-rbac-proxy-self/0.log" Jun 11 21:31:44.441336 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:44.441242 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7776c7cb6f-pdnhk_8227700d-9984-4afd-9c05-43986a9b3968/metrics-server/0.log" Jun 11 21:31:44.506413 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:44.506382 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:44.506554 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:44.506436 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:31:44.641135 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:44.641066 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-m6dbr_061f56fc-167c-40b4-b4cd-2fb63d818e8c/monitoring-plugin/0.log" Jun 11 21:31:45.044342 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:45.044313 2578 patch_prober.go:28] interesting pod/console-55b95c46-fhls4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 11 21:31:45.044721 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:45.044375 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-55b95c46-fhls4" podUID="e06283ba-f547-475c-9a71-37f3576dc93a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 11 21:31:46.041556 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:46.041524 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n22ft_cb731c62-5d8c-40c3-989c-5f4cf5f09a6e/init-textfile/0.log" Jun 11 21:31:46.242257 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:46.242229 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n22ft_cb731c62-5d8c-40c3-989c-5f4cf5f09a6e/node-exporter/0.log" Jun 11 21:31:46.441863 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:46.441780 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n22ft_cb731c62-5d8c-40c3-989c-5f4cf5f09a6e/kube-rbac-proxy/0.log" Jun 11 21:31:49.230585 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:49.230547 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:31:49.232816 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:49.232797 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/050b45ae-ece1-41ae-a59b-f8f81db2cf7e-metrics-certs\") pod \"network-metrics-daemon-4t9th\" (UID: \"050b45ae-ece1-41ae-a59b-f8f81db2cf7e\") " pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:31:49.351269 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:49.351233 2578 patch_prober.go:28] interesting pod/console-5bbd85c69c-bk74t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 11 21:31:49.351445 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:49.351284 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bbd85c69c-bk74t" podUID="38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 11 21:31:49.438384 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:49.438350 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cmhqk\"" Jun 11 21:31:49.445710 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:49.445688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4t9th" Jun 11 21:31:49.570717 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:49.570627 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4t9th"] Jun 11 21:31:49.573173 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:31:49.573147 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod050b45ae_ece1_41ae_a59b_f8f81db2cf7e.slice/crio-0bdb331d002a362f9ea368b46b9b0f2891c90016d3e9d4d11f21673f0878aacc WatchSource:0}: Error finding container 0bdb331d002a362f9ea368b46b9b0f2891c90016d3e9d4d11f21673f0878aacc: Status 404 returned error can't find the container with id 0bdb331d002a362f9ea368b46b9b0f2891c90016d3e9d4d11f21673f0878aacc Jun 11 21:31:49.841891 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:49.841865 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/thanos-query/0.log" Jun 11 21:31:50.041826 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:50.041793 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/kube-rbac-proxy-web/0.log" Jun 11 21:31:50.192130 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:50.192043 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4t9th" event={"ID":"050b45ae-ece1-41ae-a59b-f8f81db2cf7e","Type":"ContainerStarted","Data":"0bdb331d002a362f9ea368b46b9b0f2891c90016d3e9d4d11f21673f0878aacc"} Jun 11 21:31:50.241815 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:50.241769 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/kube-rbac-proxy/0.log" Jun 11 21:31:50.441579 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:50.441550 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/prom-label-proxy/0.log" Jun 11 21:31:50.641510 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:50.641487 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/kube-rbac-proxy-rules/0.log" Jun 11 21:31:50.842196 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:50.842173 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/kube-rbac-proxy-metrics/0.log" Jun 11 21:31:51.197800 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:51.197764 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4t9th" event={"ID":"050b45ae-ece1-41ae-a59b-f8f81db2cf7e","Type":"ContainerStarted","Data":"c5d204a543ec058ac79892260937c846873ebffa6c16740d5a91908ca43c9e5e"} Jun 11 21:31:51.197994 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:51.197831 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4t9th" event={"ID":"050b45ae-ece1-41ae-a59b-f8f81db2cf7e","Type":"ContainerStarted","Data":"d3909fe3c47b509881310decf1b72e6f901ce7cd677f57dac151fc718896673c"} Jun 11 21:31:51.215623 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:51.215574 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4t9th" podStartSLOduration=253.160958314 podStartE2EDuration="4m14.21555839s" totalImagesPullingTime="1.054600076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:31:51.213823956 +0000 UTC m=+254.361765106" watchObservedRunningTime="2026-06-11 21:31:51.21555839 +0000 UTC m=+254.363499538" Jun 11 21:31:51.642481 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:51.642456 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55b95c46-fhls4_e06283ba-f547-475c-9a71-37f3576dc93a/console/0.log" Jun 11 21:31:51.842624 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:51.842601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bbd85c69c-bk74t_38ea4229-c4bc-4419-bb30-d35a7b2fcfa0/console/0.log" Jun 11 21:31:52.241341 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:52.241316 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9bcbfd55b-4bt7w_49c588f4-35c1-4515-8bfd-addad7a0799c/console/0.log" Jun 11 21:31:54.026205 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:54.026167 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9bcbfd55b-4bt7w" podUID="49c588f4-35c1-4515-8bfd-addad7a0799c" containerName="console" containerID="cri-o://d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056" gracePeriod=15 Jun 11 21:31:54.041586 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:54.041565 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-965jb_a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23/dns-node-resolver/0.log" Jun 11 21:31:55.041549 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:55.041517 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bsx4x_d06fa857-a932-4daf-b686-a0e47fbc56cc/node-ca/0.log" Jun 11 21:31:55.044099 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:55.044076 2578 patch_prober.go:28] interesting pod/console-55b95c46-fhls4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 11 21:31:55.044181 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:55.044118 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-55b95c46-fhls4" podUID="e06283ba-f547-475c-9a71-37f3576dc93a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 11 21:31:55.441905 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:55.441828 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd9d485dd-lrv8r_c172843b-7283-481f-a7b9-bb5378f186c6/router/0.log" Jun 11 21:31:56.045253 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:56.045223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4slm_26373a4a-7b9f-4023-bf1e-71e354fe85e4/serve-healthcheck-canary/0.log" Jun 11 21:31:59.350640 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:59.350601 2578 patch_prober.go:28] interesting pod/console-5bbd85c69c-bk74t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 11 21:31:59.351018 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:31:59.350688 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bbd85c69c-bk74t" podUID="38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 11 21:32:03.250763 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:03.250735 2578 generic.go:356] "Generic (PLEG): container finished" podID="8e33d48e-9524-47e7-b1a6-6d11f4c7d584" containerID="ed692255635b779b850bb3f4c88b392da0b7e7a3b08d7f26b0f4317d4e1be54a" exitCode=0 Jun 11 21:32:03.251078 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:03.250803 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" event={"ID":"8e33d48e-9524-47e7-b1a6-6d11f4c7d584","Type":"ContainerDied","Data":"ed692255635b779b850bb3f4c88b392da0b7e7a3b08d7f26b0f4317d4e1be54a"} Jun 11 21:32:03.251131 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:03.251113 2578 scope.go:117] "RemoveContainer" containerID="ed692255635b779b850bb3f4c88b392da0b7e7a3b08d7f26b0f4317d4e1be54a" Jun 11 21:32:04.256232 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:04.256198 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-vt69x" event={"ID":"8e33d48e-9524-47e7-b1a6-6d11f4c7d584","Type":"ContainerStarted","Data":"06ac20ede1b5123441c69dc8506ff646da915973a78402d3b95a388cfdc93d8e"} Jun 11 21:32:04.512033 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:04.512007 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:32:04.515728 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:04.515706 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7776c7cb6f-pdnhk" Jun 11 21:32:05.044592 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:05.044556 2578 patch_prober.go:28] interesting pod/console-55b95c46-fhls4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 11 21:32:05.044760 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:05.044609 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-55b95c46-fhls4" podUID="e06283ba-f547-475c-9a71-37f3576dc93a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 11 21:32:09.157905 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.157885 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9bcbfd55b-4bt7w_49c588f4-35c1-4515-8bfd-addad7a0799c/console/0.log" Jun 11 21:32:09.159052 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.159037 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:32:09.277528 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.277498 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9bcbfd55b-4bt7w_49c588f4-35c1-4515-8bfd-addad7a0799c/console/0.log" Jun 11 21:32:09.277727 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.277540 2578 generic.go:356] "Generic (PLEG): container finished" podID="49c588f4-35c1-4515-8bfd-addad7a0799c" containerID="d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056" exitCode=137 Jun 11 21:32:09.277727 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.277576 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bcbfd55b-4bt7w" event={"ID":"49c588f4-35c1-4515-8bfd-addad7a0799c","Type":"ContainerDied","Data":"d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056"} Jun 11 21:32:09.277727 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.277603 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9bcbfd55b-4bt7w" Jun 11 21:32:09.277727 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.277623 2578 scope.go:117] "RemoveContainer" containerID="d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056" Jun 11 21:32:09.277927 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.277613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9bcbfd55b-4bt7w" event={"ID":"49c588f4-35c1-4515-8bfd-addad7a0799c","Type":"ContainerDied","Data":"e78c01f820642af6412d13196f5d20bda3f65eef35862010ce2cec2537be6ce3"} Jun 11 21:32:09.285419 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.285402 2578 scope.go:117] "RemoveContainer" containerID="d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056" Jun 11 21:32:09.285672 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:32:09.285639 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056\": container with ID starting with d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056 not found: ID does not exist" containerID="d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056" Jun 11 21:32:09.285728 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.285681 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056"} err="failed to get container status \"d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056\": rpc error: code = NotFound desc = could not find container \"d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056\": container with ID starting with d3389dd945c800945c455b8b5f0fdca4dd4121a49dc66426d0b695d0894e2056 not found: ID does not exist" Jun 11 21:32:09.287888 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.287872 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-console-config\") pod \"49c588f4-35c1-4515-8bfd-addad7a0799c\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " Jun 11 21:32:09.287949 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.287917 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-oauth-serving-cert\") pod \"49c588f4-35c1-4515-8bfd-addad7a0799c\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " Jun 11 21:32:09.288007 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.287977 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-oauth-config\") pod \"49c588f4-35c1-4515-8bfd-addad7a0799c\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " Jun 11 21:32:09.288007 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.287995 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-serving-cert\") pod \"49c588f4-35c1-4515-8bfd-addad7a0799c\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " Jun 11 21:32:09.288108 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.288011 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrj5d\" (UniqueName: \"kubernetes.io/projected/49c588f4-35c1-4515-8bfd-addad7a0799c-kube-api-access-wrj5d\") pod \"49c588f4-35c1-4515-8bfd-addad7a0799c\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " Jun 11 21:32:09.288108 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.288031 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-service-ca\") pod \"49c588f4-35c1-4515-8bfd-addad7a0799c\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " Jun 11 21:32:09.288108 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.288070 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-trusted-ca-bundle\") pod \"49c588f4-35c1-4515-8bfd-addad7a0799c\" (UID: \"49c588f4-35c1-4515-8bfd-addad7a0799c\") " Jun 11 21:32:09.288324 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.288304 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-console-config" (OuterVolumeSpecName: "console-config") pod "49c588f4-35c1-4515-8bfd-addad7a0799c" (UID: "49c588f4-35c1-4515-8bfd-addad7a0799c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:32:09.288432 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.288407 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "49c588f4-35c1-4515-8bfd-addad7a0799c" (UID: "49c588f4-35c1-4515-8bfd-addad7a0799c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:32:09.288541 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.288518 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-service-ca" (OuterVolumeSpecName: "service-ca") pod "49c588f4-35c1-4515-8bfd-addad7a0799c" (UID: "49c588f4-35c1-4515-8bfd-addad7a0799c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:32:09.288589 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.288543 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "49c588f4-35c1-4515-8bfd-addad7a0799c" (UID: "49c588f4-35c1-4515-8bfd-addad7a0799c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:32:09.290126 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.290102 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "49c588f4-35c1-4515-8bfd-addad7a0799c" (UID: "49c588f4-35c1-4515-8bfd-addad7a0799c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:32:09.290461 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.290437 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "49c588f4-35c1-4515-8bfd-addad7a0799c" (UID: "49c588f4-35c1-4515-8bfd-addad7a0799c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:32:09.290510 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.290484 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c588f4-35c1-4515-8bfd-addad7a0799c-kube-api-access-wrj5d" (OuterVolumeSpecName: "kube-api-access-wrj5d") pod "49c588f4-35c1-4515-8bfd-addad7a0799c" (UID: "49c588f4-35c1-4515-8bfd-addad7a0799c"). InnerVolumeSpecName "kube-api-access-wrj5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:32:09.350462 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.350440 2578 patch_prober.go:28] interesting pod/console-5bbd85c69c-bk74t container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 11 21:32:09.350563 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.350479 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bbd85c69c-bk74t" podUID="38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 11 21:32:09.389144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.388850 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-trusted-ca-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:09.389144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.388876 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-console-config\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:09.389144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.388891 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-oauth-serving-cert\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:09.389144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.388905 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-oauth-config\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:09.389144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.388918 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/49c588f4-35c1-4515-8bfd-addad7a0799c-console-serving-cert\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:09.389144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.388932 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrj5d\" (UniqueName: \"kubernetes.io/projected/49c588f4-35c1-4515-8bfd-addad7a0799c-kube-api-access-wrj5d\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:09.389144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.388944 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/49c588f4-35c1-4515-8bfd-addad7a0799c-service-ca\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:09.595281 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.595207 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9bcbfd55b-4bt7w"] Jun 11 21:32:09.601020 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:09.598334 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9bcbfd55b-4bt7w"] Jun 11 21:32:11.339347 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:11.339310 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49c588f4-35c1-4515-8bfd-addad7a0799c" path="/var/lib/kubelet/pods/49c588f4-35c1-4515-8bfd-addad7a0799c/volumes" Jun 11 21:32:15.048146 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:15.048120 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:32:15.052073 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:15.052049 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:32:17.812240 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:32:17.812196 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jnqmc" podUID="b4131642-3181-49b5-a6ff-e144ceae9785" Jun 11 21:32:18.312569 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:18.312542 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jnqmc" Jun 11 21:32:19.355091 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:19.355063 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:32:19.358951 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:19.358927 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:32:19.417149 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:19.417116 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55b95c46-fhls4"] Jun 11 21:32:21.592307 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:21.592270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:32:21.594599 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:21.594568 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b4131642-3181-49b5-a6ff-e144ceae9785-metrics-tls\") pod \"dns-default-jnqmc\" (UID: \"b4131642-3181-49b5-a6ff-e144ceae9785\") " pod="openshift-dns/dns-default-jnqmc" Jun 11 21:32:21.616869 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:21.616848 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kf2x8\"" Jun 11 21:32:21.624231 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:21.624214 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jnqmc" Jun 11 21:32:21.749951 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:21.749886 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jnqmc"] Jun 11 21:32:21.752411 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:32:21.752389 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4131642_3181_49b5_a6ff_e144ceae9785.slice/crio-56b6d2d7a22d2b80805857c9ae56b8abbf099f563e6662fcd5e1405e608a82c4 WatchSource:0}: Error finding container 56b6d2d7a22d2b80805857c9ae56b8abbf099f563e6662fcd5e1405e608a82c4: Status 404 returned error can't find the container with id 56b6d2d7a22d2b80805857c9ae56b8abbf099f563e6662fcd5e1405e608a82c4 Jun 11 21:32:22.329209 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:22.329174 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jnqmc" event={"ID":"b4131642-3181-49b5-a6ff-e144ceae9785","Type":"ContainerStarted","Data":"56b6d2d7a22d2b80805857c9ae56b8abbf099f563e6662fcd5e1405e608a82c4"} Jun 11 21:32:24.340494 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:24.340462 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jnqmc" event={"ID":"b4131642-3181-49b5-a6ff-e144ceae9785","Type":"ContainerStarted","Data":"5bc4fc25fe788f0c075f14883f7ddee07b093c179749b5cc075536dc41a26e15"} Jun 11 21:32:24.340905 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:24.340511 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jnqmc" event={"ID":"b4131642-3181-49b5-a6ff-e144ceae9785","Type":"ContainerStarted","Data":"c378ad6a971967bdbb126c47a69256adb4831c8d7692b82213bc034722073a80"} Jun 11 21:32:24.340905 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:24.340577 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jnqmc" Jun 11 21:32:24.361202 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:24.361151 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jnqmc" podStartSLOduration=251.361167951 podStartE2EDuration="4m13.361135228s" totalImagesPullingTime="1.999967277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:32:24.360389185 +0000 UTC m=+287.508330334" watchObservedRunningTime="2026-06-11 21:32:24.361135228 +0000 UTC m=+287.509076380" Jun 11 21:32:34.347976 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:34.347947 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jnqmc" Jun 11 21:32:37.072406 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.072368 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69f647579-lwk62"] Jun 11 21:32:37.072861 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.072847 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c588f4-35c1-4515-8bfd-addad7a0799c" containerName="console" Jun 11 21:32:37.072929 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.072866 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c588f4-35c1-4515-8bfd-addad7a0799c" containerName="console" Jun 11 21:32:37.072981 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.072965 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c588f4-35c1-4515-8bfd-addad7a0799c" containerName="console" Jun 11 21:32:37.076207 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.076186 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.088248 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.088226 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69f647579-lwk62"] Jun 11 21:32:37.221367 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.221337 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-console-config\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.221367 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.221368 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-trusted-ca-bundle\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.221546 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.221388 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-service-ca\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.221546 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.221477 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-oauth-serving-cert\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.221546 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.221511 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-oauth-config\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.221546 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.221532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-serving-cert\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.221696 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.221601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pgfk\" (UniqueName: \"kubernetes.io/projected/f1175c53-199e-4437-aaaf-1fe108acf640-kube-api-access-4pgfk\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.284219 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.284197 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:32:37.284349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.284299 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:32:37.294983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.294964 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 21:32:37.322683 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.322620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-oauth-serving-cert\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.322683 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.322666 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-oauth-config\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.322784 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.322697 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-serving-cert\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.322784 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.322744 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pgfk\" (UniqueName: \"kubernetes.io/projected/f1175c53-199e-4437-aaaf-1fe108acf640-kube-api-access-4pgfk\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.322784 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.322775 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-console-config\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.322899 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.322803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-trusted-ca-bundle\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.322899 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.322830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-service-ca\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.323426 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.323404 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-console-config\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.323426 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.323413 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-oauth-serving-cert\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.323586 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.323469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-service-ca\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.323837 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.323814 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-trusted-ca-bundle\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.325116 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.325098 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-oauth-config\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.325213 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.325195 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-serving-cert\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.331057 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.331034 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pgfk\" (UniqueName: \"kubernetes.io/projected/f1175c53-199e-4437-aaaf-1fe108acf640-kube-api-access-4pgfk\") pod \"console-69f647579-lwk62\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.385894 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.385784 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:37.512761 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:37.512735 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69f647579-lwk62"] Jun 11 21:32:37.514563 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:32:37.514535 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1175c53_199e_4437_aaaf_1fe108acf640.slice/crio-f2cf9e334b2dc8995d1a5d3e41d348a1a58f41e66503524c6c37f9a75960aa0a WatchSource:0}: Error finding container f2cf9e334b2dc8995d1a5d3e41d348a1a58f41e66503524c6c37f9a75960aa0a: Status 404 returned error can't find the container with id f2cf9e334b2dc8995d1a5d3e41d348a1a58f41e66503524c6c37f9a75960aa0a Jun 11 21:32:38.402421 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:38.402374 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f647579-lwk62" event={"ID":"f1175c53-199e-4437-aaaf-1fe108acf640","Type":"ContainerStarted","Data":"491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210"} Jun 11 21:32:38.402829 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:38.402475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f647579-lwk62" event={"ID":"f1175c53-199e-4437-aaaf-1fe108acf640","Type":"ContainerStarted","Data":"f2cf9e334b2dc8995d1a5d3e41d348a1a58f41e66503524c6c37f9a75960aa0a"} Jun 11 21:32:38.422692 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:38.422618 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69f647579-lwk62" podStartSLOduration=1.422601184 podStartE2EDuration="1.422601184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:32:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:32:38.421889086 +0000 UTC m=+301.569830236" watchObservedRunningTime="2026-06-11 21:32:38.422601184 +0000 UTC m=+301.570542332" Jun 11 21:32:44.436225 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.436153 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55b95c46-fhls4" podUID="e06283ba-f547-475c-9a71-37f3576dc93a" containerName="console" containerID="cri-o://9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04" gracePeriod=15 Jun 11 21:32:44.668142 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.668119 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:32:44.671934 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.671916 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92kqf\" (UniqueName: \"kubernetes.io/projected/e06283ba-f547-475c-9a71-37f3576dc93a-kube-api-access-92kqf\") pod \"e06283ba-f547-475c-9a71-37f3576dc93a\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " Jun 11 21:32:44.672012 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.671949 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-console-config\") pod \"e06283ba-f547-475c-9a71-37f3576dc93a\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " Jun 11 21:32:44.672012 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.671966 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-oauth-config\") pod \"e06283ba-f547-475c-9a71-37f3576dc93a\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " Jun 11 21:32:44.672012 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.671992 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-serving-cert\") pod \"e06283ba-f547-475c-9a71-37f3576dc93a\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " Jun 11 21:32:44.672156 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.672015 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-oauth-serving-cert\") pod \"e06283ba-f547-475c-9a71-37f3576dc93a\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " Jun 11 21:32:44.672207 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.672167 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-service-ca\") pod \"e06283ba-f547-475c-9a71-37f3576dc93a\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " Jun 11 21:32:44.672423 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.672389 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-console-config" (OuterVolumeSpecName: "console-config") pod "e06283ba-f547-475c-9a71-37f3576dc93a" (UID: "e06283ba-f547-475c-9a71-37f3576dc93a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:32:44.672536 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.672426 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e06283ba-f547-475c-9a71-37f3576dc93a" (UID: "e06283ba-f547-475c-9a71-37f3576dc93a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:32:44.672777 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.672759 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e06283ba-f547-475c-9a71-37f3576dc93a" (UID: "e06283ba-f547-475c-9a71-37f3576dc93a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:32:44.674102 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.674074 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e06283ba-f547-475c-9a71-37f3576dc93a" (UID: "e06283ba-f547-475c-9a71-37f3576dc93a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:32:44.674435 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.674417 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e06283ba-f547-475c-9a71-37f3576dc93a" (UID: "e06283ba-f547-475c-9a71-37f3576dc93a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:32:44.674485 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.674433 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e06283ba-f547-475c-9a71-37f3576dc93a-kube-api-access-92kqf" (OuterVolumeSpecName: "kube-api-access-92kqf") pod "e06283ba-f547-475c-9a71-37f3576dc93a" (UID: "e06283ba-f547-475c-9a71-37f3576dc93a"). InnerVolumeSpecName "kube-api-access-92kqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:32:44.773527 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.773505 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-trusted-ca-bundle\") pod \"e06283ba-f547-475c-9a71-37f3576dc93a\" (UID: \"e06283ba-f547-475c-9a71-37f3576dc93a\") " Jun 11 21:32:44.773721 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.773707 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-console-config\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:44.773776 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.773723 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-oauth-config\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:44.773776 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.773733 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e06283ba-f547-475c-9a71-37f3576dc93a-console-serving-cert\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:44.773776 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.773742 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-oauth-serving-cert\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:44.773776 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.773751 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-service-ca\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:44.773776 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.773759 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92kqf\" (UniqueName: \"kubernetes.io/projected/e06283ba-f547-475c-9a71-37f3576dc93a-kube-api-access-92kqf\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:44.773921 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.773831 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e06283ba-f547-475c-9a71-37f3576dc93a" (UID: "e06283ba-f547-475c-9a71-37f3576dc93a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:32:44.874428 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:44.874400 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e06283ba-f547-475c-9a71-37f3576dc93a-trusted-ca-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:32:45.432908 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:45.432877 2578 generic.go:356] "Generic (PLEG): container finished" podID="e06283ba-f547-475c-9a71-37f3576dc93a" containerID="9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04" exitCode=0 Jun 11 21:32:45.433097 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:45.432926 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55b95c46-fhls4" Jun 11 21:32:45.433097 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:45.432923 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b95c46-fhls4" event={"ID":"e06283ba-f547-475c-9a71-37f3576dc93a","Type":"ContainerDied","Data":"9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04"} Jun 11 21:32:45.433097 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:45.433033 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55b95c46-fhls4" event={"ID":"e06283ba-f547-475c-9a71-37f3576dc93a","Type":"ContainerDied","Data":"052fa417de960719432c6f23d7850fd1d04735ffaa78a0bc964bcf3a88873965"} Jun 11 21:32:45.433097 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:45.433053 2578 scope.go:117] "RemoveContainer" containerID="9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04" Jun 11 21:32:45.443298 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:45.443113 2578 scope.go:117] "RemoveContainer" containerID="9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04" Jun 11 21:32:45.443518 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:32:45.443358 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04\": container with ID starting with 9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04 not found: ID does not exist" containerID="9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04" Jun 11 21:32:45.443518 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:45.443386 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04"} err="failed to get container status \"9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04\": rpc error: code = NotFound desc = could not find container \"9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04\": container with ID starting with 9844ddbd9290bdeb0f2ca8d5f7a7951d67651763030cab260f5bffe0611d1f04 not found: ID does not exist" Jun 11 21:32:45.450873 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:45.450852 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55b95c46-fhls4"] Jun 11 21:32:45.456484 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:45.456462 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55b95c46-fhls4"] Jun 11 21:32:47.340294 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:47.340261 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e06283ba-f547-475c-9a71-37f3576dc93a" path="/var/lib/kubelet/pods/e06283ba-f547-475c-9a71-37f3576dc93a/volumes" Jun 11 21:32:47.386143 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:47.386116 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:47.386301 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:47.386207 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:47.390795 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:47.390776 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:47.445552 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:47.445527 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69f647579-lwk62" Jun 11 21:32:47.489850 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:32:47.489818 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bbd85c69c-bk74t"] Jun 11 21:33:12.516296 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.516232 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bbd85c69c-bk74t" podUID="38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" containerName="console" containerID="cri-o://92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db" gracePeriod=15 Jun 11 21:33:12.757468 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.757446 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:33:12.790878 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.790821 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-oauth-serving-cert\") pod \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " Jun 11 21:33:12.790878 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.790870 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tdr5\" (UniqueName: \"kubernetes.io/projected/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-kube-api-access-5tdr5\") pod \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " Jun 11 21:33:12.791065 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.790893 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-config\") pod \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " Jun 11 21:33:12.791065 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.790928 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-service-ca\") pod \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " Jun 11 21:33:12.791065 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.790944 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-oauth-config\") pod \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " Jun 11 21:33:12.791065 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.790962 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-trusted-ca-bundle\") pod \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " Jun 11 21:33:12.791065 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.790984 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-serving-cert\") pod \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\" (UID: \"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0\") " Jun 11 21:33:12.791347 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.791312 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" (UID: "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:33:12.791469 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.791435 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-service-ca" (OuterVolumeSpecName: "service-ca") pod "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" (UID: "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:33:12.791469 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.791442 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" (UID: "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:33:12.791693 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.791665 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-config" (OuterVolumeSpecName: "console-config") pod "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" (UID: "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:33:12.793058 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.793027 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-kube-api-access-5tdr5" (OuterVolumeSpecName: "kube-api-access-5tdr5") pod "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" (UID: "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0"). InnerVolumeSpecName "kube-api-access-5tdr5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:33:12.793154 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.793099 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" (UID: "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:33:12.793564 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.793549 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" (UID: "38ea4229-c4bc-4419-bb30-d35a7b2fcfa0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:33:12.892069 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.892045 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-service-ca\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:33:12.892069 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.892068 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-oauth-config\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:33:12.892196 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.892078 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-trusted-ca-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:33:12.892196 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.892087 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-serving-cert\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:33:12.892196 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.892096 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-oauth-serving-cert\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:33:12.892196 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.892104 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tdr5\" (UniqueName: \"kubernetes.io/projected/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-kube-api-access-5tdr5\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:33:12.892196 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:12.892113 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0-console-config\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:33:13.536508 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:13.536479 2578 generic.go:356] "Generic (PLEG): container finished" podID="38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" containerID="92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db" exitCode=0 Jun 11 21:33:13.536895 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:13.536537 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bbd85c69c-bk74t" Jun 11 21:33:13.536895 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:13.536540 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbd85c69c-bk74t" event={"ID":"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0","Type":"ContainerDied","Data":"92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db"} Jun 11 21:33:13.536895 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:13.536578 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bbd85c69c-bk74t" event={"ID":"38ea4229-c4bc-4419-bb30-d35a7b2fcfa0","Type":"ContainerDied","Data":"cebea68eaa7a27f12fe2c63a41ad5b6567674749bb26c5e704434a0a98fb9c56"} Jun 11 21:33:13.536895 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:13.536599 2578 scope.go:117] "RemoveContainer" containerID="92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db" Jun 11 21:33:13.546474 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:13.546450 2578 scope.go:117] "RemoveContainer" containerID="92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db" Jun 11 21:33:13.546859 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:33:13.546829 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db\": container with ID starting with 92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db not found: ID does not exist" containerID="92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db" Jun 11 21:33:13.546968 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:13.546866 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db"} err="failed to get container status \"92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db\": rpc error: code = NotFound desc = could not find container \"92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db\": container with ID starting with 92de0e01d2ebaeca0304cd01fe5d004f391d2fdd6847697d694a828bf95926db not found: ID does not exist" Jun 11 21:33:13.557216 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:13.556349 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bbd85c69c-bk74t"] Jun 11 21:33:13.557940 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:13.557920 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bbd85c69c-bk74t"] Jun 11 21:33:15.339543 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:33:15.339469 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" path="/var/lib/kubelet/pods/38ea4229-c4bc-4419-bb30-d35a7b2fcfa0/volumes" Jun 11 21:36:30.391521 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.391444 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6576b864d8-8h5jg"] Jun 11 21:36:30.391995 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.391736 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e06283ba-f547-475c-9a71-37f3576dc93a" containerName="console" Jun 11 21:36:30.391995 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.391749 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e06283ba-f547-475c-9a71-37f3576dc93a" containerName="console" Jun 11 21:36:30.391995 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.391761 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" containerName="console" Jun 11 21:36:30.391995 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.391767 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" containerName="console" Jun 11 21:36:30.391995 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.391840 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e06283ba-f547-475c-9a71-37f3576dc93a" containerName="console" Jun 11 21:36:30.391995 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.391847 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="38ea4229-c4bc-4419-bb30-d35a7b2fcfa0" containerName="console" Jun 11 21:36:30.394607 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.394584 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.417534 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.417510 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6576b864d8-8h5jg"] Jun 11 21:36:30.536607 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.536574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-console-config\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.536607 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.536612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-trusted-ca-bundle\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.536841 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.536633 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-console-oauth-config\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.536841 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.536721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-service-ca\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.536841 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.536739 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-console-serving-cert\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.536841 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.536757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq5x8\" (UniqueName: \"kubernetes.io/projected/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-kube-api-access-mq5x8\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.536841 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.536778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-oauth-serving-cert\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.638156 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.638108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-service-ca\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.638156 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.638157 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-console-serving-cert\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.638415 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.638176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq5x8\" (UniqueName: \"kubernetes.io/projected/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-kube-api-access-mq5x8\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.638415 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.638199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-oauth-serving-cert\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.638415 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.638231 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-console-config\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.638415 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.638254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-trusted-ca-bundle\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.638415 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.638285 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-console-oauth-config\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.638939 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.638904 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-service-ca\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.639045 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.638981 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-console-config\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.639045 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.639028 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-oauth-serving-cert\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.639180 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.639162 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-trusted-ca-bundle\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.641170 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.641148 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-console-oauth-config\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.641296 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.641276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-console-serving-cert\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.646169 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.646126 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq5x8\" (UniqueName: \"kubernetes.io/projected/71bf7f50-9cd9-4e85-ae56-af74cfa23be0-kube-api-access-mq5x8\") pod \"console-6576b864d8-8h5jg\" (UID: \"71bf7f50-9cd9-4e85-ae56-af74cfa23be0\") " pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.704141 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.704112 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:30.831968 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:30.831942 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6576b864d8-8h5jg"] Jun 11 21:36:30.834216 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:36:30.834192 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71bf7f50_9cd9_4e85_ae56_af74cfa23be0.slice/crio-47509ca0a8fb4b54b3b8a6c837b550bcf6f1e29640da87ea60179121628b4fe9 WatchSource:0}: Error finding container 47509ca0a8fb4b54b3b8a6c837b550bcf6f1e29640da87ea60179121628b4fe9: Status 404 returned error can't find the container with id 47509ca0a8fb4b54b3b8a6c837b550bcf6f1e29640da87ea60179121628b4fe9 Jun 11 21:36:31.290829 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:31.290790 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6576b864d8-8h5jg" event={"ID":"71bf7f50-9cd9-4e85-ae56-af74cfa23be0","Type":"ContainerStarted","Data":"d1ae861113cfd6af8a09b77f66ab4ded118159e103121f7cf2934faeeb99c07b"} Jun 11 21:36:31.291038 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:31.290849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6576b864d8-8h5jg" event={"ID":"71bf7f50-9cd9-4e85-ae56-af74cfa23be0","Type":"ContainerStarted","Data":"47509ca0a8fb4b54b3b8a6c837b550bcf6f1e29640da87ea60179121628b4fe9"} Jun 11 21:36:31.310215 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:31.310167 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6576b864d8-8h5jg" podStartSLOduration=1.310152562 podStartE2EDuration="1.310152562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:36:31.308003691 +0000 UTC m=+534.455944853" watchObservedRunningTime="2026-06-11 21:36:31.310152562 +0000 UTC m=+534.458093712" Jun 11 21:36:40.704479 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:40.704391 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:40.704479 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:40.704442 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:40.709153 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:40.709133 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:41.339708 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:41.339682 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6576b864d8-8h5jg" Jun 11 21:36:41.387953 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:36:41.387912 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69f647579-lwk62"] Jun 11 21:37:06.410291 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.410248 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69f647579-lwk62" podUID="f1175c53-199e-4437-aaaf-1fe108acf640" containerName="console" containerID="cri-o://491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210" gracePeriod=15 Jun 11 21:37:06.648083 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.648057 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f647579-lwk62" Jun 11 21:37:06.828207 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828181 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-console-config\") pod \"f1175c53-199e-4437-aaaf-1fe108acf640\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " Jun 11 21:37:06.828349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828212 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-service-ca\") pod \"f1175c53-199e-4437-aaaf-1fe108acf640\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " Jun 11 21:37:06.828349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828233 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-trusted-ca-bundle\") pod \"f1175c53-199e-4437-aaaf-1fe108acf640\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " Jun 11 21:37:06.828349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828272 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-oauth-serving-cert\") pod \"f1175c53-199e-4437-aaaf-1fe108acf640\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " Jun 11 21:37:06.828485 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828396 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-serving-cert\") pod \"f1175c53-199e-4437-aaaf-1fe108acf640\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " Jun 11 21:37:06.828485 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828451 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-oauth-config\") pod \"f1175c53-199e-4437-aaaf-1fe108acf640\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " Jun 11 21:37:06.828586 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828529 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pgfk\" (UniqueName: \"kubernetes.io/projected/f1175c53-199e-4437-aaaf-1fe108acf640-kube-api-access-4pgfk\") pod \"f1175c53-199e-4437-aaaf-1fe108acf640\" (UID: \"f1175c53-199e-4437-aaaf-1fe108acf640\") " Jun 11 21:37:06.828639 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828610 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f1175c53-199e-4437-aaaf-1fe108acf640" (UID: "f1175c53-199e-4437-aaaf-1fe108acf640"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:37:06.828639 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828626 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-service-ca" (OuterVolumeSpecName: "service-ca") pod "f1175c53-199e-4437-aaaf-1fe108acf640" (UID: "f1175c53-199e-4437-aaaf-1fe108acf640"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:37:06.828821 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828637 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-console-config" (OuterVolumeSpecName: "console-config") pod "f1175c53-199e-4437-aaaf-1fe108acf640" (UID: "f1175c53-199e-4437-aaaf-1fe108acf640"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:37:06.828821 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828776 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f1175c53-199e-4437-aaaf-1fe108acf640" (UID: "f1175c53-199e-4437-aaaf-1fe108acf640"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:37:06.828888 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828842 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-console-config\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:06.828888 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828865 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-service-ca\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:06.828888 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828876 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-trusted-ca-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:06.828985 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.828890 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1175c53-199e-4437-aaaf-1fe108acf640-oauth-serving-cert\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:06.830604 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.830579 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f1175c53-199e-4437-aaaf-1fe108acf640" (UID: "f1175c53-199e-4437-aaaf-1fe108acf640"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:37:06.830748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.830611 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1175c53-199e-4437-aaaf-1fe108acf640-kube-api-access-4pgfk" (OuterVolumeSpecName: "kube-api-access-4pgfk") pod "f1175c53-199e-4437-aaaf-1fe108acf640" (UID: "f1175c53-199e-4437-aaaf-1fe108acf640"). InnerVolumeSpecName "kube-api-access-4pgfk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:37:06.830748 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.830695 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f1175c53-199e-4437-aaaf-1fe108acf640" (UID: "f1175c53-199e-4437-aaaf-1fe108acf640"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:37:06.929874 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.929849 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-serving-cert\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:06.929874 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.929871 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1175c53-199e-4437-aaaf-1fe108acf640-console-oauth-config\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:06.930021 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:06.929880 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pgfk\" (UniqueName: \"kubernetes.io/projected/f1175c53-199e-4437-aaaf-1fe108acf640-kube-api-access-4pgfk\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:07.422494 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:07.422464 2578 generic.go:356] "Generic (PLEG): container finished" podID="f1175c53-199e-4437-aaaf-1fe108acf640" containerID="491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210" exitCode=0 Jun 11 21:37:07.422926 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:07.422507 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69f647579-lwk62" Jun 11 21:37:07.422926 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:07.422513 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f647579-lwk62" event={"ID":"f1175c53-199e-4437-aaaf-1fe108acf640","Type":"ContainerDied","Data":"491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210"} Jun 11 21:37:07.422926 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:07.422550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69f647579-lwk62" event={"ID":"f1175c53-199e-4437-aaaf-1fe108acf640","Type":"ContainerDied","Data":"f2cf9e334b2dc8995d1a5d3e41d348a1a58f41e66503524c6c37f9a75960aa0a"} Jun 11 21:37:07.422926 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:07.422570 2578 scope.go:117] "RemoveContainer" containerID="491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210" Jun 11 21:37:07.430750 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:07.430729 2578 scope.go:117] "RemoveContainer" containerID="491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210" Jun 11 21:37:07.432151 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:37:07.432126 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210\": container with ID starting with 491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210 not found: ID does not exist" containerID="491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210" Jun 11 21:37:07.432255 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:07.432163 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210"} err="failed to get container status \"491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210\": rpc error: code = NotFound desc = could not find container \"491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210\": container with ID starting with 491d018f5b069c187681ce50b92ba7bda993f3eaf089222fa08f3ff6be3a4210 not found: ID does not exist" Jun 11 21:37:07.441850 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:07.441825 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69f647579-lwk62"] Jun 11 21:37:07.443373 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:07.443354 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69f647579-lwk62"] Jun 11 21:37:09.340271 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:09.340237 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1175c53-199e-4437-aaaf-1fe108acf640" path="/var/lib/kubelet/pods/f1175c53-199e-4437-aaaf-1fe108acf640/volumes" Jun 11 21:37:19.275448 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.275414 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c"] Jun 11 21:37:19.275944 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.275762 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1175c53-199e-4437-aaaf-1fe108acf640" containerName="console" Jun 11 21:37:19.275944 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.275776 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1175c53-199e-4437-aaaf-1fe108acf640" containerName="console" Jun 11 21:37:19.275944 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.275826 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1175c53-199e-4437-aaaf-1fe108acf640" containerName="console" Jun 11 21:37:19.278765 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.278748 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.281903 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.281882 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:37:19.281903 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.281890 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:37:19.283522 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.283479 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2v2ml\"" Jun 11 21:37:19.288402 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.288379 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c"] Jun 11 21:37:19.319217 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.319194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.319315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.319240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.319315 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.319266 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l676b\" (UniqueName: \"kubernetes.io/projected/d2617f65-9eaa-4642-a50a-3a75a8deb732-kube-api-access-l676b\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.420524 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.420497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.420687 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.420545 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.420687 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.420564 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l676b\" (UniqueName: \"kubernetes.io/projected/d2617f65-9eaa-4642-a50a-3a75a8deb732-kube-api-access-l676b\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.420881 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.420864 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.420987 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.420900 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.430039 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.430010 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l676b\" (UniqueName: \"kubernetes.io/projected/d2617f65-9eaa-4642-a50a-3a75a8deb732-kube-api-access-l676b\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.587571 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.587502 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:19.717283 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.717259 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c"] Jun 11 21:37:19.720002 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:37:19.719979 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2617f65_9eaa_4642_a50a_3a75a8deb732.slice/crio-bfc6e0273fbae929d5d70fb189da3f3b993eddd0d683d4c8de325db0a44b801b WatchSource:0}: Error finding container bfc6e0273fbae929d5d70fb189da3f3b993eddd0d683d4c8de325db0a44b801b: Status 404 returned error can't find the container with id bfc6e0273fbae929d5d70fb189da3f3b993eddd0d683d4c8de325db0a44b801b Jun 11 21:37:19.722346 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:19.722330 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:37:20.473171 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:20.473137 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" event={"ID":"d2617f65-9eaa-4642-a50a-3a75a8deb732","Type":"ContainerStarted","Data":"bfc6e0273fbae929d5d70fb189da3f3b993eddd0d683d4c8de325db0a44b801b"} Jun 11 21:37:28.506581 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:28.506534 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2617f65-9eaa-4642-a50a-3a75a8deb732" containerID="ec3cf1f84db3df40f4d2340d919d656a56afa70e07a4c5719cfc4d709d1e85a6" exitCode=0 Jun 11 21:37:28.506968 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:28.506583 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" event={"ID":"d2617f65-9eaa-4642-a50a-3a75a8deb732","Type":"ContainerDied","Data":"ec3cf1f84db3df40f4d2340d919d656a56afa70e07a4c5719cfc4d709d1e85a6"} Jun 11 21:37:31.519510 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:31.519480 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2617f65-9eaa-4642-a50a-3a75a8deb732" containerID="c079f3f4cbf013d9e2240197169163d0f01ba0b1be3282eb5ebf7fa6147e9b39" exitCode=0 Jun 11 21:37:31.519895 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:31.519565 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" event={"ID":"d2617f65-9eaa-4642-a50a-3a75a8deb732","Type":"ContainerDied","Data":"c079f3f4cbf013d9e2240197169163d0f01ba0b1be3282eb5ebf7fa6147e9b39"} Jun 11 21:37:37.320575 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:37.320545 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:37:37.321106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:37.321084 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:37:40.565406 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:40.565367 2578 generic.go:356] "Generic (PLEG): container finished" podID="d2617f65-9eaa-4642-a50a-3a75a8deb732" containerID="55113140e9a2ff35b5ec71cd6ad82c56ad7792ae5534a99126a06e499f82829c" exitCode=0 Jun 11 21:37:40.565900 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:40.565435 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" event={"ID":"d2617f65-9eaa-4642-a50a-3a75a8deb732","Type":"ContainerDied","Data":"55113140e9a2ff35b5ec71cd6ad82c56ad7792ae5534a99126a06e499f82829c"} Jun 11 21:37:41.689247 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:41.689222 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:41.800142 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:41.800106 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l676b\" (UniqueName: \"kubernetes.io/projected/d2617f65-9eaa-4642-a50a-3a75a8deb732-kube-api-access-l676b\") pod \"d2617f65-9eaa-4642-a50a-3a75a8deb732\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " Jun 11 21:37:41.800317 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:41.800226 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-util\") pod \"d2617f65-9eaa-4642-a50a-3a75a8deb732\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " Jun 11 21:37:41.800317 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:41.800262 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-bundle\") pod \"d2617f65-9eaa-4642-a50a-3a75a8deb732\" (UID: \"d2617f65-9eaa-4642-a50a-3a75a8deb732\") " Jun 11 21:37:41.800939 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:41.800917 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-bundle" (OuterVolumeSpecName: "bundle") pod "d2617f65-9eaa-4642-a50a-3a75a8deb732" (UID: "d2617f65-9eaa-4642-a50a-3a75a8deb732"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:37:41.802288 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:41.802269 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2617f65-9eaa-4642-a50a-3a75a8deb732-kube-api-access-l676b" (OuterVolumeSpecName: "kube-api-access-l676b") pod "d2617f65-9eaa-4642-a50a-3a75a8deb732" (UID: "d2617f65-9eaa-4642-a50a-3a75a8deb732"). InnerVolumeSpecName "kube-api-access-l676b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:37:41.805209 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:41.805183 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-util" (OuterVolumeSpecName: "util") pod "d2617f65-9eaa-4642-a50a-3a75a8deb732" (UID: "d2617f65-9eaa-4642-a50a-3a75a8deb732"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:37:41.901891 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:41.901819 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-util\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:41.901891 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:41.901844 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2617f65-9eaa-4642-a50a-3a75a8deb732-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:41.901891 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:41.901854 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l676b\" (UniqueName: \"kubernetes.io/projected/d2617f65-9eaa-4642-a50a-3a75a8deb732-kube-api-access-l676b\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:42.574926 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:42.574889 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" event={"ID":"d2617f65-9eaa-4642-a50a-3a75a8deb732","Type":"ContainerDied","Data":"bfc6e0273fbae929d5d70fb189da3f3b993eddd0d683d4c8de325db0a44b801b"} Jun 11 21:37:42.574926 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:42.574918 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dxbq8c" Jun 11 21:37:42.574926 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:42.574935 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bfc6e0273fbae929d5d70fb189da3f3b993eddd0d683d4c8de325db0a44b801b" Jun 11 21:37:47.012147 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.012059 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k"] Jun 11 21:37:47.012509 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.012370 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2617f65-9eaa-4642-a50a-3a75a8deb732" containerName="extract" Jun 11 21:37:47.012509 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.012382 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2617f65-9eaa-4642-a50a-3a75a8deb732" containerName="extract" Jun 11 21:37:47.012509 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.012393 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2617f65-9eaa-4642-a50a-3a75a8deb732" containerName="pull" Jun 11 21:37:47.012509 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.012398 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2617f65-9eaa-4642-a50a-3a75a8deb732" containerName="pull" Jun 11 21:37:47.012509 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.012410 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2617f65-9eaa-4642-a50a-3a75a8deb732" containerName="util" Jun 11 21:37:47.012509 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.012418 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2617f65-9eaa-4642-a50a-3a75a8deb732" containerName="util" Jun 11 21:37:47.012509 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.012470 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2617f65-9eaa-4642-a50a-3a75a8deb732" containerName="extract" Jun 11 21:37:47.014349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.014334 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" Jun 11 21:37:47.017298 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.017276 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 11 21:37:47.017417 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.017302 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:37:47.017417 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.017313 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-w4lbt\"" Jun 11 21:37:47.029386 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.029362 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k"] Jun 11 21:37:47.144427 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.144392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcfbc391-baab-4c25-88ef-7bb44c47a2a5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-dh52k\" (UID: \"dcfbc391-baab-4c25-88ef-7bb44c47a2a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" Jun 11 21:37:47.144580 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.144440 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmlw9\" (UniqueName: \"kubernetes.io/projected/dcfbc391-baab-4c25-88ef-7bb44c47a2a5-kube-api-access-bmlw9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-dh52k\" (UID: \"dcfbc391-baab-4c25-88ef-7bb44c47a2a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" Jun 11 21:37:47.245409 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.245370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcfbc391-baab-4c25-88ef-7bb44c47a2a5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-dh52k\" (UID: \"dcfbc391-baab-4c25-88ef-7bb44c47a2a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" Jun 11 21:37:47.245575 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.245417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmlw9\" (UniqueName: \"kubernetes.io/projected/dcfbc391-baab-4c25-88ef-7bb44c47a2a5-kube-api-access-bmlw9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-dh52k\" (UID: \"dcfbc391-baab-4c25-88ef-7bb44c47a2a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" Jun 11 21:37:47.245791 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.245771 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dcfbc391-baab-4c25-88ef-7bb44c47a2a5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-dh52k\" (UID: \"dcfbc391-baab-4c25-88ef-7bb44c47a2a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" Jun 11 21:37:47.254319 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.254294 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmlw9\" (UniqueName: \"kubernetes.io/projected/dcfbc391-baab-4c25-88ef-7bb44c47a2a5-kube-api-access-bmlw9\") pod \"cert-manager-operator-controller-manager-57757f7cfc-dh52k\" (UID: \"dcfbc391-baab-4c25-88ef-7bb44c47a2a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" Jun 11 21:37:47.323058 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.322979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" Jun 11 21:37:47.453900 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.453876 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k"] Jun 11 21:37:47.456489 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:37:47.456459 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcfbc391_baab_4c25_88ef_7bb44c47a2a5.slice/crio-25029111b34df96f0ea3ee32176b9b8157325e505da751a5c782478d3a0ddc4b WatchSource:0}: Error finding container 25029111b34df96f0ea3ee32176b9b8157325e505da751a5c782478d3a0ddc4b: Status 404 returned error can't find the container with id 25029111b34df96f0ea3ee32176b9b8157325e505da751a5c782478d3a0ddc4b Jun 11 21:37:47.597119 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:47.597047 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" event={"ID":"dcfbc391-baab-4c25-88ef-7bb44c47a2a5","Type":"ContainerStarted","Data":"25029111b34df96f0ea3ee32176b9b8157325e505da751a5c782478d3a0ddc4b"} Jun 11 21:37:49.610633 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:49.610577 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" event={"ID":"dcfbc391-baab-4c25-88ef-7bb44c47a2a5","Type":"ContainerStarted","Data":"459893a3f4fa9ede7082dbb6d90e0890bea265f829eccc92ba9518c17a006144"} Jun 11 21:37:49.634207 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:49.634156 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-dh52k" podStartSLOduration=2.185763316 podStartE2EDuration="3.634141488s" totalImagesPullingTime="1.448378172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:37:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:37:49.631427461 +0000 UTC m=+612.779368610" watchObservedRunningTime="2026-06-11 21:37:49.634141488 +0000 UTC m=+612.782082636" Jun 11 21:37:51.476062 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.476023 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg"] Jun 11 21:37:51.479482 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.479466 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.482325 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.482304 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:37:51.482450 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.482359 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:37:51.483750 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.483736 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2v2ml\"" Jun 11 21:37:51.489320 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.489298 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg"] Jun 11 21:37:51.580574 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.580543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b265l\" (UniqueName: \"kubernetes.io/projected/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-kube-api-access-b265l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.580736 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.580578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.580736 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.580600 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.681848 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.681823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b265l\" (UniqueName: \"kubernetes.io/projected/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-kube-api-access-b265l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.681983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.681856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.681983 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.681887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.682193 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.682175 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.682250 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.682234 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.690471 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.690436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b265l\" (UniqueName: \"kubernetes.io/projected/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-kube-api-access-b265l\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.789593 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.789570 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:51.922914 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:51.922890 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg"] Jun 11 21:37:51.925153 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:37:51.925129 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee3548d_ead8_4bbb_bf5e_f1d054796f8c.slice/crio-3ca968aa44346bb9113a62e160ee6819f91e9777cd875404e05890fa17f357c2 WatchSource:0}: Error finding container 3ca968aa44346bb9113a62e160ee6819f91e9777cd875404e05890fa17f357c2: Status 404 returned error can't find the container with id 3ca968aa44346bb9113a62e160ee6819f91e9777cd875404e05890fa17f357c2 Jun 11 21:37:52.499963 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.499925 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7"] Jun 11 21:37:52.503161 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.503141 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" Jun 11 21:37:52.506091 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.506071 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 21:37:52.506091 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.506079 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jbtsw\"" Jun 11 21:37:52.507508 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.507493 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 21:37:52.514025 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.514005 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7"] Jun 11 21:37:52.589188 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.589163 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qjwq\" (UniqueName: \"kubernetes.io/projected/5780fae3-181e-4a5c-ac9e-8bd75ba58842-kube-api-access-8qjwq\") pod \"cert-manager-webhook-7dc76cbb94-6lhj7\" (UID: \"5780fae3-181e-4a5c-ac9e-8bd75ba58842\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" Jun 11 21:37:52.589328 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.589200 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5780fae3-181e-4a5c-ac9e-8bd75ba58842-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6lhj7\" (UID: \"5780fae3-181e-4a5c-ac9e-8bd75ba58842\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" Jun 11 21:37:52.624468 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.624438 2578 generic.go:356] "Generic (PLEG): container finished" podID="4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" containerID="44140c9c5376c8b0e5ea5b374adcfa6eb349678093ec6a55548302abafabda84" exitCode=0 Jun 11 21:37:52.624612 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.624486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" event={"ID":"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c","Type":"ContainerDied","Data":"44140c9c5376c8b0e5ea5b374adcfa6eb349678093ec6a55548302abafabda84"} Jun 11 21:37:52.624612 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.624521 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" event={"ID":"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c","Type":"ContainerStarted","Data":"3ca968aa44346bb9113a62e160ee6819f91e9777cd875404e05890fa17f357c2"} Jun 11 21:37:52.690506 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.690478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qjwq\" (UniqueName: \"kubernetes.io/projected/5780fae3-181e-4a5c-ac9e-8bd75ba58842-kube-api-access-8qjwq\") pod \"cert-manager-webhook-7dc76cbb94-6lhj7\" (UID: \"5780fae3-181e-4a5c-ac9e-8bd75ba58842\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" Jun 11 21:37:52.690638 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.690514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5780fae3-181e-4a5c-ac9e-8bd75ba58842-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6lhj7\" (UID: \"5780fae3-181e-4a5c-ac9e-8bd75ba58842\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" Jun 11 21:37:52.698865 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.698842 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5780fae3-181e-4a5c-ac9e-8bd75ba58842-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6lhj7\" (UID: \"5780fae3-181e-4a5c-ac9e-8bd75ba58842\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" Jun 11 21:37:52.699461 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.699439 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qjwq\" (UniqueName: \"kubernetes.io/projected/5780fae3-181e-4a5c-ac9e-8bd75ba58842-kube-api-access-8qjwq\") pod \"cert-manager-webhook-7dc76cbb94-6lhj7\" (UID: \"5780fae3-181e-4a5c-ac9e-8bd75ba58842\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" Jun 11 21:37:52.811750 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.811723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" Jun 11 21:37:52.946223 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:52.946139 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7"] Jun 11 21:37:52.948295 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:37:52.948267 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5780fae3_181e_4a5c_ac9e_8bd75ba58842.slice/crio-e274e31550ae8343d707004c37777dffa8562ed6beef3b820448a52368d1a5f4 WatchSource:0}: Error finding container e274e31550ae8343d707004c37777dffa8562ed6beef3b820448a52368d1a5f4: Status 404 returned error can't find the container with id e274e31550ae8343d707004c37777dffa8562ed6beef3b820448a52368d1a5f4 Jun 11 21:37:53.630550 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:53.630514 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" event={"ID":"5780fae3-181e-4a5c-ac9e-8bd75ba58842","Type":"ContainerStarted","Data":"e274e31550ae8343d707004c37777dffa8562ed6beef3b820448a52368d1a5f4"} Jun 11 21:37:56.647005 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:56.646972 2578 generic.go:356] "Generic (PLEG): container finished" podID="4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" containerID="4ce579a393d854efb5c9a19bd75eb9b5e52b6b0788b96bd51acc6d9ceab7f1a3" exitCode=0 Jun 11 21:37:56.647421 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:56.647043 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" event={"ID":"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c","Type":"ContainerDied","Data":"4ce579a393d854efb5c9a19bd75eb9b5e52b6b0788b96bd51acc6d9ceab7f1a3"} Jun 11 21:37:56.648667 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:56.648623 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" event={"ID":"5780fae3-181e-4a5c-ac9e-8bd75ba58842","Type":"ContainerStarted","Data":"1e8c70859fd1cdbe3c6e52cbaac03696c487c6644f3123dfa13ace844609cfe5"} Jun 11 21:37:56.648774 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:56.648763 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" Jun 11 21:37:56.682615 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:56.682574 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" podStartSLOduration=1.8653269319999999 podStartE2EDuration="4.68256039s" totalImagesPullingTime="2.817233458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:37:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:37:56.681844934 +0000 UTC m=+619.829786080" watchObservedRunningTime="2026-06-11 21:37:56.68256039 +0000 UTC m=+619.830501539" Jun 11 21:37:57.654454 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:57.654420 2578 generic.go:356] "Generic (PLEG): container finished" podID="4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" containerID="d3b1fb277bf7fb95b6f1ffef808971b251a1321d57ca8942483712ca387dee8a" exitCode=0 Jun 11 21:37:57.654923 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:57.654503 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" event={"ID":"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c","Type":"ContainerDied","Data":"d3b1fb277bf7fb95b6f1ffef808971b251a1321d57ca8942483712ca387dee8a"} Jun 11 21:37:58.782690 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:58.782666 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:58.945491 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:58.945403 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-bundle\") pod \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " Jun 11 21:37:58.945491 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:58.945445 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-util\") pod \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " Jun 11 21:37:58.945491 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:58.945475 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b265l\" (UniqueName: \"kubernetes.io/projected/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-kube-api-access-b265l\") pod \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\" (UID: \"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c\") " Jun 11 21:37:58.945818 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:58.945795 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-bundle" (OuterVolumeSpecName: "bundle") pod "4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" (UID: "4ee3548d-ead8-4bbb-bf5e-f1d054796f8c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:37:58.947473 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:58.947441 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-kube-api-access-b265l" (OuterVolumeSpecName: "kube-api-access-b265l") pod "4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" (UID: "4ee3548d-ead8-4bbb-bf5e-f1d054796f8c"). InnerVolumeSpecName "kube-api-access-b265l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:37:58.950045 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:58.950019 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-util" (OuterVolumeSpecName: "util") pod "4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" (UID: "4ee3548d-ead8-4bbb-bf5e-f1d054796f8c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:37:59.046173 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:59.046146 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:59.046173 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:59.046168 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-util\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:59.046173 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:59.046178 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b265l\" (UniqueName: \"kubernetes.io/projected/4ee3548d-ead8-4bbb-bf5e-f1d054796f8c-kube-api-access-b265l\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:37:59.664084 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:59.664004 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" Jun 11 21:37:59.664084 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:59.664022 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgvtgg" event={"ID":"4ee3548d-ead8-4bbb-bf5e-f1d054796f8c","Type":"ContainerDied","Data":"3ca968aa44346bb9113a62e160ee6819f91e9777cd875404e05890fa17f357c2"} Jun 11 21:37:59.664084 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:37:59.664063 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ca968aa44346bb9113a62e160ee6819f91e9777cd875404e05890fa17f357c2" Jun 11 21:38:02.657640 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:02.657611 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6lhj7" Jun 11 21:38:13.359491 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.359452 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2"] Jun 11 21:38:13.360090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.359904 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" containerName="util" Jun 11 21:38:13.360090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.359924 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" containerName="util" Jun 11 21:38:13.360090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.359934 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" containerName="pull" Jun 11 21:38:13.360090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.359942 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" containerName="pull" Jun 11 21:38:13.360090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.359958 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" containerName="extract" Jun 11 21:38:13.360090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.359966 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" containerName="extract" Jun 11 21:38:13.360090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.360074 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee3548d-ead8-4bbb-bf5e-f1d054796f8c" containerName="extract" Jun 11 21:38:13.363778 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.363757 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.366492 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.366472 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:38:13.368259 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.368237 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:38:13.368372 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.368337 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2v2ml\"" Jun 11 21:38:13.370924 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.370901 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2"] Jun 11 21:38:13.464335 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.464309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.464490 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.464351 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g56m2\" (UniqueName: \"kubernetes.io/projected/085f7bd5-9afb-48a5-920f-b0a0acd933a5-kube-api-access-g56m2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.464490 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.464371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.565144 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.565112 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.565289 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.565166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g56m2\" (UniqueName: \"kubernetes.io/projected/085f7bd5-9afb-48a5-920f-b0a0acd933a5-kube-api-access-g56m2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.565289 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.565193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.565462 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.565442 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.565531 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.565515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.573365 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.573331 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g56m2\" (UniqueName: \"kubernetes.io/projected/085f7bd5-9afb-48a5-920f-b0a0acd933a5-kube-api-access-g56m2\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.673800 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.673725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:13.798696 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:13.798667 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2"] Jun 11 21:38:13.801066 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:38:13.801039 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085f7bd5_9afb_48a5_920f_b0a0acd933a5.slice/crio-395324c366e16593719a88726936106292e7ea549f59aee282818cdf67eabb8e WatchSource:0}: Error finding container 395324c366e16593719a88726936106292e7ea549f59aee282818cdf67eabb8e: Status 404 returned error can't find the container with id 395324c366e16593719a88726936106292e7ea549f59aee282818cdf67eabb8e Jun 11 21:38:14.726694 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:14.726641 2578 generic.go:356] "Generic (PLEG): container finished" podID="085f7bd5-9afb-48a5-920f-b0a0acd933a5" containerID="7832a1358a6d1053ee231bd8244d1346254a41b13c1b50a252b1dd65320ec04b" exitCode=0 Jun 11 21:38:14.727068 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:14.726736 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" event={"ID":"085f7bd5-9afb-48a5-920f-b0a0acd933a5","Type":"ContainerDied","Data":"7832a1358a6d1053ee231bd8244d1346254a41b13c1b50a252b1dd65320ec04b"} Jun 11 21:38:14.727068 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:14.726782 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" event={"ID":"085f7bd5-9afb-48a5-920f-b0a0acd933a5","Type":"ContainerStarted","Data":"395324c366e16593719a88726936106292e7ea549f59aee282818cdf67eabb8e"} Jun 11 21:38:15.733490 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:15.733453 2578 generic.go:356] "Generic (PLEG): container finished" podID="085f7bd5-9afb-48a5-920f-b0a0acd933a5" containerID="2b70c1464e7ca200e3d23c4ec9ce365df9d98fd4510aaa0109de4f9d88a8356a" exitCode=0 Jun 11 21:38:15.733870 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:15.733501 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" event={"ID":"085f7bd5-9afb-48a5-920f-b0a0acd933a5","Type":"ContainerDied","Data":"2b70c1464e7ca200e3d23c4ec9ce365df9d98fd4510aaa0109de4f9d88a8356a"} Jun 11 21:38:16.739746 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:16.739713 2578 generic.go:356] "Generic (PLEG): container finished" podID="085f7bd5-9afb-48a5-920f-b0a0acd933a5" containerID="f9eb5bfd20fd78c1d146f69e7eed16fb8b06162598101e4fb99c95d385447996" exitCode=0 Jun 11 21:38:16.740125 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:16.739773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" event={"ID":"085f7bd5-9afb-48a5-920f-b0a0acd933a5","Type":"ContainerDied","Data":"f9eb5bfd20fd78c1d146f69e7eed16fb8b06162598101e4fb99c95d385447996"} Jun 11 21:38:17.871184 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:17.871161 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:17.895989 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:17.895966 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-bundle\") pod \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " Jun 11 21:38:17.896106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:17.896026 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g56m2\" (UniqueName: \"kubernetes.io/projected/085f7bd5-9afb-48a5-920f-b0a0acd933a5-kube-api-access-g56m2\") pod \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " Jun 11 21:38:17.896106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:17.896049 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-util\") pod \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\" (UID: \"085f7bd5-9afb-48a5-920f-b0a0acd933a5\") " Jun 11 21:38:17.896691 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:17.896642 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-bundle" (OuterVolumeSpecName: "bundle") pod "085f7bd5-9afb-48a5-920f-b0a0acd933a5" (UID: "085f7bd5-9afb-48a5-920f-b0a0acd933a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:38:17.898019 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:17.897986 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085f7bd5-9afb-48a5-920f-b0a0acd933a5-kube-api-access-g56m2" (OuterVolumeSpecName: "kube-api-access-g56m2") pod "085f7bd5-9afb-48a5-920f-b0a0acd933a5" (UID: "085f7bd5-9afb-48a5-920f-b0a0acd933a5"). InnerVolumeSpecName "kube-api-access-g56m2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:38:17.902083 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:17.902054 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-util" (OuterVolumeSpecName: "util") pod "085f7bd5-9afb-48a5-920f-b0a0acd933a5" (UID: "085f7bd5-9afb-48a5-920f-b0a0acd933a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:38:17.996996 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:17.996955 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:38:17.996996 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:17.996996 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g56m2\" (UniqueName: \"kubernetes.io/projected/085f7bd5-9afb-48a5-920f-b0a0acd933a5-kube-api-access-g56m2\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:38:17.997160 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:17.997011 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/085f7bd5-9afb-48a5-920f-b0a0acd933a5-util\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:38:18.750289 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:18.750255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" event={"ID":"085f7bd5-9afb-48a5-920f-b0a0acd933a5","Type":"ContainerDied","Data":"395324c366e16593719a88726936106292e7ea549f59aee282818cdf67eabb8e"} Jun 11 21:38:18.750289 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:18.750287 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjm4c2" Jun 11 21:38:18.750485 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:18.750306 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="395324c366e16593719a88726936106292e7ea549f59aee282818cdf67eabb8e" Jun 11 21:38:23.430110 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.430076 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w"] Jun 11 21:38:23.430583 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.430506 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085f7bd5-9afb-48a5-920f-b0a0acd933a5" containerName="extract" Jun 11 21:38:23.430583 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.430533 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="085f7bd5-9afb-48a5-920f-b0a0acd933a5" containerName="extract" Jun 11 21:38:23.430583 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.430552 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085f7bd5-9afb-48a5-920f-b0a0acd933a5" containerName="util" Jun 11 21:38:23.430583 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.430560 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="085f7bd5-9afb-48a5-920f-b0a0acd933a5" containerName="util" Jun 11 21:38:23.430821 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.430587 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085f7bd5-9afb-48a5-920f-b0a0acd933a5" containerName="pull" Jun 11 21:38:23.430821 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.430596 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="085f7bd5-9afb-48a5-920f-b0a0acd933a5" containerName="pull" Jun 11 21:38:23.430821 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.430714 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="085f7bd5-9afb-48a5-920f-b0a0acd933a5" containerName="extract" Jun 11 21:38:23.432863 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.432843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.437869 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.437847 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 21:38:23.437988 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.437863 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s2zjb\"" Jun 11 21:38:23.437988 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.437961 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 21:38:23.438108 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.437985 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:38:23.438108 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.437863 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 21:38:23.438108 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.437880 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 21:38:23.444055 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.444036 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w"] Jun 11 21:38:23.536695 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.536666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5vck\" (UniqueName: \"kubernetes.io/projected/562de15a-cf4f-4888-8f25-e62910c377a2-kube-api-access-h5vck\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.536833 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.536719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/562de15a-cf4f-4888-8f25-e62910c377a2-manager-config\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.536833 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.536792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/562de15a-cf4f-4888-8f25-e62910c377a2-cert\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.536904 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.536846 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/562de15a-cf4f-4888-8f25-e62910c377a2-metrics-cert\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.637926 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.637900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/562de15a-cf4f-4888-8f25-e62910c377a2-cert\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.638057 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.637932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/562de15a-cf4f-4888-8f25-e62910c377a2-metrics-cert\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.638057 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.637956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5vck\" (UniqueName: \"kubernetes.io/projected/562de15a-cf4f-4888-8f25-e62910c377a2-kube-api-access-h5vck\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.638057 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.637989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/562de15a-cf4f-4888-8f25-e62910c377a2-manager-config\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.638572 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.638538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/562de15a-cf4f-4888-8f25-e62910c377a2-manager-config\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.640388 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.640366 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/562de15a-cf4f-4888-8f25-e62910c377a2-metrics-cert\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.640482 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.640402 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/562de15a-cf4f-4888-8f25-e62910c377a2-cert\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.656004 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.655982 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5vck\" (UniqueName: \"kubernetes.io/projected/562de15a-cf4f-4888-8f25-e62910c377a2-kube-api-access-h5vck\") pod \"lws-controller-manager-7cc86d56d6-scf4w\" (UID: \"562de15a-cf4f-4888-8f25-e62910c377a2\") " pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.741914 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.741847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:23.864134 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:23.864035 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w"] Jun 11 21:38:23.866787 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:38:23.866759 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562de15a_cf4f_4888_8f25_e62910c377a2.slice/crio-53bd6c90666122feb3aed30e936d00cb9a09fe78486cd2c4a4c93b6e13c35940 WatchSource:0}: Error finding container 53bd6c90666122feb3aed30e936d00cb9a09fe78486cd2c4a4c93b6e13c35940: Status 404 returned error can't find the container with id 53bd6c90666122feb3aed30e936d00cb9a09fe78486cd2c4a4c93b6e13c35940 Jun 11 21:38:24.778152 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:24.778116 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" event={"ID":"562de15a-cf4f-4888-8f25-e62910c377a2","Type":"ContainerStarted","Data":"53bd6c90666122feb3aed30e936d00cb9a09fe78486cd2c4a4c93b6e13c35940"} Jun 11 21:38:25.784129 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:25.784092 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" event={"ID":"562de15a-cf4f-4888-8f25-e62910c377a2","Type":"ContainerStarted","Data":"8a04fb88b7b9e31cd68bb1403a7280b454330df8c29af4e010f4b63f91af05e3"} Jun 11 21:38:25.784538 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:25.784213 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:25.802062 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:25.802011 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" podStartSLOduration=1.326603324 podStartE2EDuration="2.801995538s" totalImagesPullingTime="1.475392214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:38:25.801511259 +0000 UTC m=+648.949452408" watchObservedRunningTime="2026-06-11 21:38:25.801995538 +0000 UTC m=+648.949936749" Jun 11 21:38:30.828606 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.828577 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx"] Jun 11 21:38:30.831174 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.831158 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:30.835815 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.835794 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 21:38:30.835943 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.835858 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 21:38:30.836122 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.836106 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vzh6m\"" Jun 11 21:38:30.836196 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.836160 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 21:38:30.836289 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.836271 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 21:38:30.850639 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.850618 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx"] Jun 11 21:38:30.899718 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.899695 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jsb4\" (UniqueName: \"kubernetes.io/projected/80a17c70-4132-4c95-9179-d42d78d8f897-kube-api-access-8jsb4\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:30.899843 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.899742 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80a17c70-4132-4c95-9179-d42d78d8f897-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:30.899843 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.899775 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80a17c70-4132-4c95-9179-d42d78d8f897-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:30.899843 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.899806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80a17c70-4132-4c95-9179-d42d78d8f897-tmp\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:30.899843 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:30.899825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80a17c70-4132-4c95-9179-d42d78d8f897-manifests\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.000535 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.000510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80a17c70-4132-4c95-9179-d42d78d8f897-manifests\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.000644 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.000554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jsb4\" (UniqueName: \"kubernetes.io/projected/80a17c70-4132-4c95-9179-d42d78d8f897-kube-api-access-8jsb4\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.000644 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.000591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80a17c70-4132-4c95-9179-d42d78d8f897-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.000644 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.000612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80a17c70-4132-4c95-9179-d42d78d8f897-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.000644 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.000635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80a17c70-4132-4c95-9179-d42d78d8f897-tmp\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.000985 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.000956 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80a17c70-4132-4c95-9179-d42d78d8f897-manifests\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.002910 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.002891 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80a17c70-4132-4c95-9179-d42d78d8f897-tmp\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.003259 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.003239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80a17c70-4132-4c95-9179-d42d78d8f897-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.003333 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.003238 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80a17c70-4132-4c95-9179-d42d78d8f897-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.012592 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.012561 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jsb4\" (UniqueName: \"kubernetes.io/projected/80a17c70-4132-4c95-9179-d42d78d8f897-kube-api-access-8jsb4\") pod \"opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx\" (UID: \"80a17c70-4132-4c95-9179-d42d78d8f897\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.141425 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.141340 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:31.273044 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.273017 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx"] Jun 11 21:38:31.275538 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:38:31.275510 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a17c70_4132_4c95_9179_d42d78d8f897.slice/crio-53f79360568b8af0f93ff6b1879fc2d980b938b9f3440fd11f5c172029a98cfb WatchSource:0}: Error finding container 53f79360568b8af0f93ff6b1879fc2d980b938b9f3440fd11f5c172029a98cfb: Status 404 returned error can't find the container with id 53f79360568b8af0f93ff6b1879fc2d980b938b9f3440fd11f5c172029a98cfb Jun 11 21:38:31.817307 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:31.817273 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" event={"ID":"80a17c70-4132-4c95-9179-d42d78d8f897","Type":"ContainerStarted","Data":"53f79360568b8af0f93ff6b1879fc2d980b938b9f3440fd11f5c172029a98cfb"} Jun 11 21:38:34.833312 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:34.833269 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" event={"ID":"80a17c70-4132-4c95-9179-d42d78d8f897","Type":"ContainerStarted","Data":"74c1548d48d2b8c7067517ef80093c17865e5cb46e50972410b3cfc134314055"} Jun 11 21:38:35.839224 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:35.839193 2578 generic.go:356] "Generic (PLEG): container finished" podID="80a17c70-4132-4c95-9179-d42d78d8f897" containerID="74c1548d48d2b8c7067517ef80093c17865e5cb46e50972410b3cfc134314055" exitCode=0 Jun 11 21:38:35.839595 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:35.839238 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" event={"ID":"80a17c70-4132-4c95-9179-d42d78d8f897","Type":"ContainerDied","Data":"74c1548d48d2b8c7067517ef80093c17865e5cb46e50972410b3cfc134314055"} Jun 11 21:38:36.790438 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:36.790410 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7cc86d56d6-scf4w" Jun 11 21:38:36.846674 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:36.846614 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" event={"ID":"80a17c70-4132-4c95-9179-d42d78d8f897","Type":"ContainerStarted","Data":"6b93392ab8101ce1f4691dfda53c4be950eec73520f75e1ca1638f8f8e549d43"} Jun 11 21:38:36.847058 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:36.846781 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:36.866682 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:36.866616 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" podStartSLOduration=2.665469427 podStartE2EDuration="6.866601146s" totalImagesPullingTime="3.223832338s" totalInitContainerRuntime="977.299381ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:38:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:38:36.865789455 +0000 UTC m=+660.013730606" watchObservedRunningTime="2026-06-11 21:38:36.866601146 +0000 UTC m=+660.014542295" Jun 11 21:38:47.853946 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:47.853915 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx" Jun 11 21:38:52.474090 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.474051 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5"] Jun 11 21:38:52.480282 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.480262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.484530 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.484282 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:38:52.484530 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.484321 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:38:52.484530 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.484374 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2v2ml\"" Jun 11 21:38:52.485034 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.485011 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5"] Jun 11 21:38:52.586421 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.586389 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.586599 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.586532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbsgz\" (UniqueName: \"kubernetes.io/projected/e8040047-6248-4f52-919a-22859b72312b-kube-api-access-tbsgz\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.586683 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.586597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.687067 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.687035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.687226 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.687094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbsgz\" (UniqueName: \"kubernetes.io/projected/e8040047-6248-4f52-919a-22859b72312b-kube-api-access-tbsgz\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.687226 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.687148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.687486 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.687465 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.687526 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.687481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.695542 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.695522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbsgz\" (UniqueName: \"kubernetes.io/projected/e8040047-6248-4f52-919a-22859b72312b-kube-api-access-tbsgz\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.790941 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.790917 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:52.918035 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:52.918011 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5"] Jun 11 21:38:52.923022 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:38:52.922977 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8040047_6248_4f52_919a_22859b72312b.slice/crio-97d6cf0f09176e623c8bf750ef8ceb8f41ba6e1caf06352c519daab394d27edd WatchSource:0}: Error finding container 97d6cf0f09176e623c8bf750ef8ceb8f41ba6e1caf06352c519daab394d27edd: Status 404 returned error can't find the container with id 97d6cf0f09176e623c8bf750ef8ceb8f41ba6e1caf06352c519daab394d27edd Jun 11 21:38:53.933424 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:53.933393 2578 generic.go:356] "Generic (PLEG): container finished" podID="e8040047-6248-4f52-919a-22859b72312b" containerID="4e1106888ea48a5c3abab3bc4f5c8d02713acdc178523acefb0e5df430f14109" exitCode=0 Jun 11 21:38:53.933834 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:53.933476 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" event={"ID":"e8040047-6248-4f52-919a-22859b72312b","Type":"ContainerDied","Data":"4e1106888ea48a5c3abab3bc4f5c8d02713acdc178523acefb0e5df430f14109"} Jun 11 21:38:53.933834 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:53.933523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" event={"ID":"e8040047-6248-4f52-919a-22859b72312b","Type":"ContainerStarted","Data":"97d6cf0f09176e623c8bf750ef8ceb8f41ba6e1caf06352c519daab394d27edd"} Jun 11 21:38:54.941884 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:54.941854 2578 generic.go:356] "Generic (PLEG): container finished" podID="e8040047-6248-4f52-919a-22859b72312b" containerID="6b05d2cc24661bee93df06f590911f4d316133ef80938119c8da7bd44593fe33" exitCode=0 Jun 11 21:38:54.942223 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:54.941935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" event={"ID":"e8040047-6248-4f52-919a-22859b72312b","Type":"ContainerDied","Data":"6b05d2cc24661bee93df06f590911f4d316133ef80938119c8da7bd44593fe33"} Jun 11 21:38:55.948210 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:55.948173 2578 generic.go:356] "Generic (PLEG): container finished" podID="e8040047-6248-4f52-919a-22859b72312b" containerID="90ba776527000aa14bf18ce955b042e34b7639cf001ac294b7074bd5965db380" exitCode=0 Jun 11 21:38:55.948642 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:55.948249 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" event={"ID":"e8040047-6248-4f52-919a-22859b72312b","Type":"ContainerDied","Data":"90ba776527000aa14bf18ce955b042e34b7639cf001ac294b7074bd5965db380"} Jun 11 21:38:57.078246 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.078222 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:57.227981 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.227913 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-util\") pod \"e8040047-6248-4f52-919a-22859b72312b\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " Jun 11 21:38:57.227981 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.227975 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-bundle\") pod \"e8040047-6248-4f52-919a-22859b72312b\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " Jun 11 21:38:57.228136 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.227992 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbsgz\" (UniqueName: \"kubernetes.io/projected/e8040047-6248-4f52-919a-22859b72312b-kube-api-access-tbsgz\") pod \"e8040047-6248-4f52-919a-22859b72312b\" (UID: \"e8040047-6248-4f52-919a-22859b72312b\") " Jun 11 21:38:57.228910 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.228875 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-bundle" (OuterVolumeSpecName: "bundle") pod "e8040047-6248-4f52-919a-22859b72312b" (UID: "e8040047-6248-4f52-919a-22859b72312b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:38:57.230097 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.230079 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8040047-6248-4f52-919a-22859b72312b-kube-api-access-tbsgz" (OuterVolumeSpecName: "kube-api-access-tbsgz") pod "e8040047-6248-4f52-919a-22859b72312b" (UID: "e8040047-6248-4f52-919a-22859b72312b"). InnerVolumeSpecName "kube-api-access-tbsgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:38:57.233198 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.233166 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-util" (OuterVolumeSpecName: "util") pod "e8040047-6248-4f52-919a-22859b72312b" (UID: "e8040047-6248-4f52-919a-22859b72312b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:38:57.329048 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.329015 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-util\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:38:57.329048 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.329041 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e8040047-6248-4f52-919a-22859b72312b-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:38:57.329048 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.329052 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbsgz\" (UniqueName: \"kubernetes.io/projected/e8040047-6248-4f52-919a-22859b72312b-kube-api-access-tbsgz\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:38:57.959461 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.959431 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" Jun 11 21:38:57.959634 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.959432 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06g5pj5" event={"ID":"e8040047-6248-4f52-919a-22859b72312b","Type":"ContainerDied","Data":"97d6cf0f09176e623c8bf750ef8ceb8f41ba6e1caf06352c519daab394d27edd"} Jun 11 21:38:57.959634 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:38:57.959556 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97d6cf0f09176e623c8bf750ef8ceb8f41ba6e1caf06352c519daab394d27edd" Jun 11 21:39:02.424227 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.424192 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z"] Jun 11 21:39:02.424659 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.424541 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8040047-6248-4f52-919a-22859b72312b" containerName="extract" Jun 11 21:39:02.424659 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.424554 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8040047-6248-4f52-919a-22859b72312b" containerName="extract" Jun 11 21:39:02.424659 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.424569 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8040047-6248-4f52-919a-22859b72312b" containerName="util" Jun 11 21:39:02.424659 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.424574 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8040047-6248-4f52-919a-22859b72312b" containerName="util" Jun 11 21:39:02.424659 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.424583 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8040047-6248-4f52-919a-22859b72312b" containerName="pull" Jun 11 21:39:02.424659 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.424592 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8040047-6248-4f52-919a-22859b72312b" containerName="pull" Jun 11 21:39:02.424840 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.424668 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8040047-6248-4f52-919a-22859b72312b" containerName="extract" Jun 11 21:39:02.427088 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.427071 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.431730 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.431706 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2v2ml\"" Jun 11 21:39:02.431855 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.431744 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 21:39:02.433042 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.433023 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 21:39:02.444564 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.444543 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z"] Jun 11 21:39:02.578016 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.577978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5hcm\" (UniqueName: \"kubernetes.io/projected/3a01821b-9534-425c-8aae-af6254886953-kube-api-access-f5hcm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.578174 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.578040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.578174 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.578136 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.679132 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.679045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5hcm\" (UniqueName: \"kubernetes.io/projected/3a01821b-9534-425c-8aae-af6254886953-kube-api-access-f5hcm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.679132 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.679094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.679356 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.679135 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.679516 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.679498 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.679582 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.679538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.727209 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.727178 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5hcm\" (UniqueName: \"kubernetes.io/projected/3a01821b-9534-425c-8aae-af6254886953-kube-api-access-f5hcm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.736314 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.736290 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:02.908403 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.908365 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z"] Jun 11 21:39:02.917728 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:39:02.917700 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a01821b_9534_425c_8aae_af6254886953.slice/crio-9d0e6a3444f2ed9086a636c1cc0b36d54df7867cbda25445613933aed03dc2b9 WatchSource:0}: Error finding container 9d0e6a3444f2ed9086a636c1cc0b36d54df7867cbda25445613933aed03dc2b9: Status 404 returned error can't find the container with id 9d0e6a3444f2ed9086a636c1cc0b36d54df7867cbda25445613933aed03dc2b9 Jun 11 21:39:02.984378 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.984351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" event={"ID":"3a01821b-9534-425c-8aae-af6254886953","Type":"ContainerStarted","Data":"781d970773cdfb6ed021f4a010e0e22d86c08bec90289a9f7f18260690746005"} Jun 11 21:39:02.984488 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:02.984411 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" event={"ID":"3a01821b-9534-425c-8aae-af6254886953","Type":"ContainerStarted","Data":"9d0e6a3444f2ed9086a636c1cc0b36d54df7867cbda25445613933aed03dc2b9"} Jun 11 21:39:03.990401 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:03.990312 2578 generic.go:356] "Generic (PLEG): container finished" podID="3a01821b-9534-425c-8aae-af6254886953" containerID="781d970773cdfb6ed021f4a010e0e22d86c08bec90289a9f7f18260690746005" exitCode=0 Jun 11 21:39:03.990401 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:03.990369 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" event={"ID":"3a01821b-9534-425c-8aae-af6254886953","Type":"ContainerDied","Data":"781d970773cdfb6ed021f4a010e0e22d86c08bec90289a9f7f18260690746005"} Jun 11 21:39:06.001602 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.001573 2578 generic.go:356] "Generic (PLEG): container finished" podID="3a01821b-9534-425c-8aae-af6254886953" containerID="2535f8047fdc23c0cd6ca6c9998605fba3c419d2a62088ecec7f59c531b51fd3" exitCode=0 Jun 11 21:39:06.002047 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.001676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" event={"ID":"3a01821b-9534-425c-8aae-af6254886953","Type":"ContainerDied","Data":"2535f8047fdc23c0cd6ca6c9998605fba3c419d2a62088ecec7f59c531b51fd3"} Jun 11 21:39:06.725178 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.725147 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs"] Jun 11 21:39:06.728379 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.728359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" Jun 11 21:39:06.732638 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.732611 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 21:39:06.734081 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.734057 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x2lng\"" Jun 11 21:39:06.765587 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.765561 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs"] Jun 11 21:39:06.822665 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.822627 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/60e0c668-a37c-4c25-bd10-54aa2fe4ccbc-redirect-config\") pod \"dashboard-redirect-6d6d9f9d7c-cbkjs\" (UID: \"60e0c668-a37c-4c25-bd10-54aa2fe4ccbc\") " pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" Jun 11 21:39:06.822824 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.822706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p56cv\" (UniqueName: \"kubernetes.io/projected/60e0c668-a37c-4c25-bd10-54aa2fe4ccbc-kube-api-access-p56cv\") pod \"dashboard-redirect-6d6d9f9d7c-cbkjs\" (UID: \"60e0c668-a37c-4c25-bd10-54aa2fe4ccbc\") " pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" Jun 11 21:39:06.923324 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.923294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/60e0c668-a37c-4c25-bd10-54aa2fe4ccbc-redirect-config\") pod \"dashboard-redirect-6d6d9f9d7c-cbkjs\" (UID: \"60e0c668-a37c-4c25-bd10-54aa2fe4ccbc\") " pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" Jun 11 21:39:06.923452 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.923329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p56cv\" (UniqueName: \"kubernetes.io/projected/60e0c668-a37c-4c25-bd10-54aa2fe4ccbc-kube-api-access-p56cv\") pod \"dashboard-redirect-6d6d9f9d7c-cbkjs\" (UID: \"60e0c668-a37c-4c25-bd10-54aa2fe4ccbc\") " pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" Jun 11 21:39:06.924003 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.923985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/60e0c668-a37c-4c25-bd10-54aa2fe4ccbc-redirect-config\") pod \"dashboard-redirect-6d6d9f9d7c-cbkjs\" (UID: \"60e0c668-a37c-4c25-bd10-54aa2fe4ccbc\") " pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" Jun 11 21:39:06.932342 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:06.932319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p56cv\" (UniqueName: \"kubernetes.io/projected/60e0c668-a37c-4c25-bd10-54aa2fe4ccbc-kube-api-access-p56cv\") pod \"dashboard-redirect-6d6d9f9d7c-cbkjs\" (UID: \"60e0c668-a37c-4c25-bd10-54aa2fe4ccbc\") " pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" Jun 11 21:39:07.009258 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:07.009230 2578 generic.go:356] "Generic (PLEG): container finished" podID="3a01821b-9534-425c-8aae-af6254886953" containerID="dc735d6c3994cbfaed28bbc0c1be97764d3e2141e6cfc033e36c8fe95a2967a3" exitCode=0 Jun 11 21:39:07.009610 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:07.009282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" event={"ID":"3a01821b-9534-425c-8aae-af6254886953","Type":"ContainerDied","Data":"dc735d6c3994cbfaed28bbc0c1be97764d3e2141e6cfc033e36c8fe95a2967a3"} Jun 11 21:39:07.038776 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:07.038753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" Jun 11 21:39:07.168782 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:07.168748 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs"] Jun 11 21:39:07.171723 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:39:07.171640 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e0c668_a37c_4c25_bd10_54aa2fe4ccbc.slice/crio-72874638e93bdfa2bbd845fbba377a4492fbe24425d786281ec5d81e5b3b9415 WatchSource:0}: Error finding container 72874638e93bdfa2bbd845fbba377a4492fbe24425d786281ec5d81e5b3b9415: Status 404 returned error can't find the container with id 72874638e93bdfa2bbd845fbba377a4492fbe24425d786281ec5d81e5b3b9415 Jun 11 21:39:08.015155 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.015119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" event={"ID":"60e0c668-a37c-4c25-bd10-54aa2fe4ccbc","Type":"ContainerStarted","Data":"72874638e93bdfa2bbd845fbba377a4492fbe24425d786281ec5d81e5b3b9415"} Jun 11 21:39:08.139392 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.139368 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:08.233186 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.233157 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5hcm\" (UniqueName: \"kubernetes.io/projected/3a01821b-9534-425c-8aae-af6254886953-kube-api-access-f5hcm\") pod \"3a01821b-9534-425c-8aae-af6254886953\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " Jun 11 21:39:08.233186 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.233190 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-bundle\") pod \"3a01821b-9534-425c-8aae-af6254886953\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " Jun 11 21:39:08.233384 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.233207 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-util\") pod \"3a01821b-9534-425c-8aae-af6254886953\" (UID: \"3a01821b-9534-425c-8aae-af6254886953\") " Jun 11 21:39:08.234412 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.234366 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-bundle" (OuterVolumeSpecName: "bundle") pod "3a01821b-9534-425c-8aae-af6254886953" (UID: "3a01821b-9534-425c-8aae-af6254886953"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:39:08.235870 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.235840 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a01821b-9534-425c-8aae-af6254886953-kube-api-access-f5hcm" (OuterVolumeSpecName: "kube-api-access-f5hcm") pod "3a01821b-9534-425c-8aae-af6254886953" (UID: "3a01821b-9534-425c-8aae-af6254886953"). InnerVolumeSpecName "kube-api-access-f5hcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:39:08.240202 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.240175 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-util" (OuterVolumeSpecName: "util") pod "3a01821b-9534-425c-8aae-af6254886953" (UID: "3a01821b-9534-425c-8aae-af6254886953"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:39:08.334907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.334822 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5hcm\" (UniqueName: \"kubernetes.io/projected/3a01821b-9534-425c-8aae-af6254886953-kube-api-access-f5hcm\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:39:08.334907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.334860 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:39:08.334907 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:08.334876 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3a01821b-9534-425c-8aae-af6254886953-util\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:39:09.023896 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:09.023867 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" Jun 11 21:39:09.023896 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:09.023900 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2hz5z" event={"ID":"3a01821b-9534-425c-8aae-af6254886953","Type":"ContainerDied","Data":"9d0e6a3444f2ed9086a636c1cc0b36d54df7867cbda25445613933aed03dc2b9"} Jun 11 21:39:09.024398 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:09.023952 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d0e6a3444f2ed9086a636c1cc0b36d54df7867cbda25445613933aed03dc2b9" Jun 11 21:39:10.030311 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:10.030277 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" event={"ID":"60e0c668-a37c-4c25-bd10-54aa2fe4ccbc","Type":"ContainerStarted","Data":"6c15b9cefd62e3c5c820e8f290e3f1f787a3fbbd6943d04a1c37b511d75413c7"} Jun 11 21:39:10.049355 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:10.049303 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d6d9f9d7c-cbkjs" podStartSLOduration=1.85180988 podStartE2EDuration="4.049290019s" totalImagesPullingTime="2.197480139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:39:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:39:10.047668178 +0000 UTC m=+693.195609330" watchObservedRunningTime="2026-06-11 21:39:10.049290019 +0000 UTC m=+693.197231213" Jun 11 21:39:28.522845 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.522777 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4"] Jun 11 21:39:28.523265 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.523125 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a01821b-9534-425c-8aae-af6254886953" containerName="pull" Jun 11 21:39:28.523265 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.523139 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a01821b-9534-425c-8aae-af6254886953" containerName="pull" Jun 11 21:39:28.523265 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.523160 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a01821b-9534-425c-8aae-af6254886953" containerName="util" Jun 11 21:39:28.523265 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.523166 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a01821b-9534-425c-8aae-af6254886953" containerName="util" Jun 11 21:39:28.523265 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.523178 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a01821b-9534-425c-8aae-af6254886953" containerName="extract" Jun 11 21:39:28.523265 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.523186 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a01821b-9534-425c-8aae-af6254886953" containerName="extract" Jun 11 21:39:28.523265 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.523241 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a01821b-9534-425c-8aae-af6254886953" containerName="extract" Jun 11 21:39:28.526286 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.526269 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.529306 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.529286 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 21:39:28.529408 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.529371 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dlsjj\"" Jun 11 21:39:28.536409 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.536386 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4"] Jun 11 21:39:28.594932 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.594906 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.595079 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.594950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.595079 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.594975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.595079 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.594993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.595079 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.595050 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.595269 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.595101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.595269 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.595130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97f66e97-769f-428e-9b6e-2d2b5c57128f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.595269 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.595155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdr9x\" (UniqueName: \"kubernetes.io/projected/97f66e97-769f-428e-9b6e-2d2b5c57128f-kube-api-access-tdr9x\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.595269 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.595188 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.696517 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.696488 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.696695 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.696536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.696695 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.696635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.696695 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.696685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.696872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.696740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.696872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.696782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.696872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.696808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97f66e97-769f-428e-9b6e-2d2b5c57128f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.696872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.696833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdr9x\" (UniqueName: \"kubernetes.io/projected/97f66e97-769f-428e-9b6e-2d2b5c57128f-kube-api-access-tdr9x\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.696872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.696868 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.697192 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.697159 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.697291 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.697267 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.697361 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.697318 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.697424 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.697401 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.697766 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.697742 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/97f66e97-769f-428e-9b6e-2d2b5c57128f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.699226 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.699204 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.699333 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.699318 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.705284 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.705260 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/97f66e97-769f-428e-9b6e-2d2b5c57128f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.705468 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.705453 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdr9x\" (UniqueName: \"kubernetes.io/projected/97f66e97-769f-428e-9b6e-2d2b5c57128f-kube-api-access-tdr9x\") pod \"data-science-gateway-data-science-gateway-class-74759f9795xh9p4\" (UID: \"97f66e97-769f-428e-9b6e-2d2b5c57128f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:28.837689 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:28.837604 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:29.007912 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:29.007867 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4"] Jun 11 21:39:29.010470 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:39:29.010442 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f66e97_769f_428e_9b6e_2d2b5c57128f.slice/crio-b49153a4ee8e06c3e6ef9ba515748039da1d963e78ca4a7a561ab0b80463fb86 WatchSource:0}: Error finding container b49153a4ee8e06c3e6ef9ba515748039da1d963e78ca4a7a561ab0b80463fb86: Status 404 returned error can't find the container with id b49153a4ee8e06c3e6ef9ba515748039da1d963e78ca4a7a561ab0b80463fb86 Jun 11 21:39:29.117836 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:29.117759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" event={"ID":"97f66e97-769f-428e-9b6e-2d2b5c57128f","Type":"ContainerStarted","Data":"b49153a4ee8e06c3e6ef9ba515748039da1d963e78ca4a7a561ab0b80463fb86"} Jun 11 21:39:31.813681 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:31.813618 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 21:39:31.814179 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:31.813722 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 21:39:31.814179 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:31.813772 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Jun 11 21:39:32.141320 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:32.141235 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" event={"ID":"97f66e97-769f-428e-9b6e-2d2b5c57128f","Type":"ContainerStarted","Data":"62c887a543cf24f0e29b013c1adcd5b28ef1516122129d2435dae468efc0d466"} Jun 11 21:39:32.166016 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:32.165972 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" podStartSLOduration=1.36508268 podStartE2EDuration="4.165956891s" totalImagesPullingTime="2.800874211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:39:32.164491535 +0000 UTC m=+715.312432684" watchObservedRunningTime="2026-06-11 21:39:32.165956891 +0000 UTC m=+715.313898039" Jun 11 21:39:32.838448 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:32.838413 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:32.843093 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:32.843067 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:33.145988 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:33.145910 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:33.146725 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:33.146705 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795xh9p4" Jun 11 21:39:51.069736 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.069701 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h62g9"] Jun 11 21:39:51.073119 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.073090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h62g9" Jun 11 21:39:51.076173 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.076148 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 21:39:51.076173 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.076148 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-v6rh4\"" Jun 11 21:39:51.076389 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.076251 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 21:39:51.086927 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.086903 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h62g9"] Jun 11 21:39:51.194946 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.194915 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg5pj\" (UniqueName: \"kubernetes.io/projected/cdfa112b-42da-4023-8521-729e8b5211b7-kube-api-access-wg5pj\") pod \"kuadrant-operator-catalog-h62g9\" (UID: \"cdfa112b-42da-4023-8521-729e8b5211b7\") " pod="kuadrant-system/kuadrant-operator-catalog-h62g9" Jun 11 21:39:51.295617 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.295586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg5pj\" (UniqueName: \"kubernetes.io/projected/cdfa112b-42da-4023-8521-729e8b5211b7-kube-api-access-wg5pj\") pod \"kuadrant-operator-catalog-h62g9\" (UID: \"cdfa112b-42da-4023-8521-729e8b5211b7\") " pod="kuadrant-system/kuadrant-operator-catalog-h62g9" Jun 11 21:39:51.306594 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.306560 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg5pj\" (UniqueName: \"kubernetes.io/projected/cdfa112b-42da-4023-8521-729e8b5211b7-kube-api-access-wg5pj\") pod \"kuadrant-operator-catalog-h62g9\" (UID: \"cdfa112b-42da-4023-8521-729e8b5211b7\") " pod="kuadrant-system/kuadrant-operator-catalog-h62g9" Jun 11 21:39:51.383091 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.383004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h62g9" Jun 11 21:39:51.433696 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.433659 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h62g9"] Jun 11 21:39:51.513840 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.513816 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h62g9"] Jun 11 21:39:51.515445 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:39:51.515417 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdfa112b_42da_4023_8521_729e8b5211b7.slice/crio-6f1ad0a764caa7991f9b36aec262549671b592524c2cf6e1207e2a43054c1068 WatchSource:0}: Error finding container 6f1ad0a764caa7991f9b36aec262549671b592524c2cf6e1207e2a43054c1068: Status 404 returned error can't find the container with id 6f1ad0a764caa7991f9b36aec262549671b592524c2cf6e1207e2a43054c1068 Jun 11 21:39:51.644791 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.644717 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t47n5"] Jun 11 21:39:51.649225 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.649210 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t47n5" Jun 11 21:39:51.658723 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.658694 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t47n5"] Jun 11 21:39:51.798979 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.798952 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk5rt\" (UniqueName: \"kubernetes.io/projected/6a9af54e-370a-46c8-899a-809e6ae453c6-kube-api-access-qk5rt\") pod \"kuadrant-operator-catalog-t47n5\" (UID: \"6a9af54e-370a-46c8-899a-809e6ae453c6\") " pod="kuadrant-system/kuadrant-operator-catalog-t47n5" Jun 11 21:39:51.899418 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.899346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk5rt\" (UniqueName: \"kubernetes.io/projected/6a9af54e-370a-46c8-899a-809e6ae453c6-kube-api-access-qk5rt\") pod \"kuadrant-operator-catalog-t47n5\" (UID: \"6a9af54e-370a-46c8-899a-809e6ae453c6\") " pod="kuadrant-system/kuadrant-operator-catalog-t47n5" Jun 11 21:39:51.907989 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.907964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk5rt\" (UniqueName: \"kubernetes.io/projected/6a9af54e-370a-46c8-899a-809e6ae453c6-kube-api-access-qk5rt\") pod \"kuadrant-operator-catalog-t47n5\" (UID: \"6a9af54e-370a-46c8-899a-809e6ae453c6\") " pod="kuadrant-system/kuadrant-operator-catalog-t47n5" Jun 11 21:39:51.958979 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:51.958939 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t47n5" Jun 11 21:39:52.107668 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:52.107628 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t47n5"] Jun 11 21:39:52.137992 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:39:52.137956 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9af54e_370a_46c8_899a_809e6ae453c6.slice/crio-9a5fe5b3d9b09ba853695b10d0868135fdb95c97af87e9aa339ab8357c222b0a WatchSource:0}: Error finding container 9a5fe5b3d9b09ba853695b10d0868135fdb95c97af87e9aa339ab8357c222b0a: Status 404 returned error can't find the container with id 9a5fe5b3d9b09ba853695b10d0868135fdb95c97af87e9aa339ab8357c222b0a Jun 11 21:39:52.237059 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:52.236983 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h62g9" event={"ID":"cdfa112b-42da-4023-8521-729e8b5211b7","Type":"ContainerStarted","Data":"6f1ad0a764caa7991f9b36aec262549671b592524c2cf6e1207e2a43054c1068"} Jun 11 21:39:52.238240 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:52.238209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t47n5" event={"ID":"6a9af54e-370a-46c8-899a-809e6ae453c6","Type":"ContainerStarted","Data":"9a5fe5b3d9b09ba853695b10d0868135fdb95c97af87e9aa339ab8357c222b0a"} Jun 11 21:39:54.251667 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:54.251613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t47n5" event={"ID":"6a9af54e-370a-46c8-899a-809e6ae453c6","Type":"ContainerStarted","Data":"a272bbc2ddd097dc09ebdb9ade255b69bb6e9ac001b364fe12f9223b62af001a"} Jun 11 21:39:54.253129 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:54.253106 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h62g9" event={"ID":"cdfa112b-42da-4023-8521-729e8b5211b7","Type":"ContainerStarted","Data":"803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e"} Jun 11 21:39:54.253232 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:54.253195 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-h62g9" podUID="cdfa112b-42da-4023-8521-729e8b5211b7" containerName="registry-server" containerID="cri-o://803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e" gracePeriod=2 Jun 11 21:39:54.286034 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:54.285983 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t47n5" podStartSLOduration=1.656906921 podStartE2EDuration="3.285967947s" totalImagesPullingTime="1.629061026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:39:54.268228307 +0000 UTC m=+737.416169460" watchObservedRunningTime="2026-06-11 21:39:54.285967947 +0000 UTC m=+737.433909096" Jun 11 21:39:54.287410 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:54.287379 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-h62g9" podStartSLOduration=1.039882667 podStartE2EDuration="3.287369427s" totalImagesPullingTime="2.24748676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:39:54.285187318 +0000 UTC m=+737.433128471" watchObservedRunningTime="2026-06-11 21:39:54.287369427 +0000 UTC m=+737.435310577" Jun 11 21:39:54.499617 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:54.499593 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h62g9" Jun 11 21:39:54.624630 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:54.624597 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg5pj\" (UniqueName: \"kubernetes.io/projected/cdfa112b-42da-4023-8521-729e8b5211b7-kube-api-access-wg5pj\") pod \"cdfa112b-42da-4023-8521-729e8b5211b7\" (UID: \"cdfa112b-42da-4023-8521-729e8b5211b7\") " Jun 11 21:39:54.626752 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:54.626729 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdfa112b-42da-4023-8521-729e8b5211b7-kube-api-access-wg5pj" (OuterVolumeSpecName: "kube-api-access-wg5pj") pod "cdfa112b-42da-4023-8521-729e8b5211b7" (UID: "cdfa112b-42da-4023-8521-729e8b5211b7"). InnerVolumeSpecName "kube-api-access-wg5pj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:39:54.725922 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:54.725893 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg5pj\" (UniqueName: \"kubernetes.io/projected/cdfa112b-42da-4023-8521-729e8b5211b7-kube-api-access-wg5pj\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:39:55.258796 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:55.258763 2578 generic.go:356] "Generic (PLEG): container finished" podID="cdfa112b-42da-4023-8521-729e8b5211b7" containerID="803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e" exitCode=0 Jun 11 21:39:55.259213 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:55.258804 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-h62g9" Jun 11 21:39:55.259213 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:55.258850 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h62g9" event={"ID":"cdfa112b-42da-4023-8521-729e8b5211b7","Type":"ContainerDied","Data":"803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e"} Jun 11 21:39:55.259213 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:55.258920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-h62g9" event={"ID":"cdfa112b-42da-4023-8521-729e8b5211b7","Type":"ContainerDied","Data":"6f1ad0a764caa7991f9b36aec262549671b592524c2cf6e1207e2a43054c1068"} Jun 11 21:39:55.259213 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:55.258941 2578 scope.go:117] "RemoveContainer" containerID="803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e" Jun 11 21:39:55.268035 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:55.268019 2578 scope.go:117] "RemoveContainer" containerID="803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e" Jun 11 21:39:55.268264 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:39:55.268249 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e\": container with ID starting with 803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e not found: ID does not exist" containerID="803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e" Jun 11 21:39:55.268305 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:55.268272 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e"} err="failed to get container status \"803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e\": rpc error: code = NotFound desc = could not find container \"803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e\": container with ID starting with 803a5f7dfd4c320663ccec6f35527f84e48540992acfc39108637e527c34e25e not found: ID does not exist" Jun 11 21:39:55.281457 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:55.281416 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h62g9"] Jun 11 21:39:55.286049 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:55.286029 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-h62g9"] Jun 11 21:39:55.339691 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:39:55.339643 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdfa112b-42da-4023-8521-729e8b5211b7" path="/var/lib/kubelet/pods/cdfa112b-42da-4023-8521-729e8b5211b7/volumes" Jun 11 21:40:01.959612 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:01.959576 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-t47n5" Jun 11 21:40:01.960137 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:01.959635 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-t47n5" Jun 11 21:40:01.981895 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:01.981862 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-t47n5" Jun 11 21:40:02.314336 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:02.314306 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-t47n5" Jun 11 21:40:06.475374 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.475340 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf"] Jun 11 21:40:06.475790 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.475743 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfa112b-42da-4023-8521-729e8b5211b7" containerName="registry-server" Jun 11 21:40:06.475790 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.475758 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfa112b-42da-4023-8521-729e8b5211b7" containerName="registry-server" Jun 11 21:40:06.475899 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.475840 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfa112b-42da-4023-8521-729e8b5211b7" containerName="registry-server" Jun 11 21:40:06.483644 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.483621 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.486990 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.486971 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2nz27\"" Jun 11 21:40:06.488094 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.488074 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf"] Jun 11 21:40:06.530641 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.530613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6nsg\" (UniqueName: \"kubernetes.io/projected/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-kube-api-access-x6nsg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.530821 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.530665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.530821 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.530787 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.632062 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.632023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.632210 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.632082 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6nsg\" (UniqueName: \"kubernetes.io/projected/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-kube-api-access-x6nsg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.632210 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.632103 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.632405 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.632388 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.632454 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.632440 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.640386 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.640356 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6nsg\" (UniqueName: \"kubernetes.io/projected/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-kube-api-access-x6nsg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.794433 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.794402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:06.921243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:06.921221 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf"] Jun 11 21:40:06.923312 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:40:06.923279 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae986bd_5918_41c7_b1a4_7f5ba4b2772c.slice/crio-0c5a4db5aa17618151729d27a2cb80085e2c709dc6f60480ee9efeaa245b34da WatchSource:0}: Error finding container 0c5a4db5aa17618151729d27a2cb80085e2c709dc6f60480ee9efeaa245b34da: Status 404 returned error can't find the container with id 0c5a4db5aa17618151729d27a2cb80085e2c709dc6f60480ee9efeaa245b34da Jun 11 21:40:07.085884 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.085811 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2"] Jun 11 21:40:07.089673 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.089638 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.097404 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.097376 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2"] Jun 11 21:40:07.137787 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.137760 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.137906 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.137800 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.137906 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.137820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss5hd\" (UniqueName: \"kubernetes.io/projected/426d304b-afb6-40f0-a25e-2da8ae42aafa-kube-api-access-ss5hd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.239128 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.239102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.239252 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.239145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.239252 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.239168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss5hd\" (UniqueName: \"kubernetes.io/projected/426d304b-afb6-40f0-a25e-2da8ae42aafa-kube-api-access-ss5hd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.239412 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.239393 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.239454 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.239433 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.247853 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.247831 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss5hd\" (UniqueName: \"kubernetes.io/projected/426d304b-afb6-40f0-a25e-2da8ae42aafa-kube-api-access-ss5hd\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.318742 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.318706 2578 generic.go:356] "Generic (PLEG): container finished" podID="aae986bd-5918-41c7-b1a4-7f5ba4b2772c" containerID="f331047142a99cf1e4974a01229eccaefb42a89877121838a8ac09c38638ebb7" exitCode=0 Jun 11 21:40:07.318872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.318794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" event={"ID":"aae986bd-5918-41c7-b1a4-7f5ba4b2772c","Type":"ContainerDied","Data":"f331047142a99cf1e4974a01229eccaefb42a89877121838a8ac09c38638ebb7"} Jun 11 21:40:07.318872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.318842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" event={"ID":"aae986bd-5918-41c7-b1a4-7f5ba4b2772c","Type":"ContainerStarted","Data":"0c5a4db5aa17618151729d27a2cb80085e2c709dc6f60480ee9efeaa245b34da"} Jun 11 21:40:07.399334 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.399254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:07.529290 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.529262 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2"] Jun 11 21:40:07.531136 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:40:07.531115 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod426d304b_afb6_40f0_a25e_2da8ae42aafa.slice/crio-e55a5824bbdb3a35edca7a0e38fb4aea89994dcf437d494c07c6a2ad8391f997 WatchSource:0}: Error finding container e55a5824bbdb3a35edca7a0e38fb4aea89994dcf437d494c07c6a2ad8391f997: Status 404 returned error can't find the container with id e55a5824bbdb3a35edca7a0e38fb4aea89994dcf437d494c07c6a2ad8391f997 Jun 11 21:40:07.673120 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.673060 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5"] Jun 11 21:40:07.676750 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.676730 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:07.686390 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.686364 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5"] Jun 11 21:40:07.743550 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.743518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsmgw\" (UniqueName: \"kubernetes.io/projected/217189cc-2639-4778-8c92-8ee83e0524a0-kube-api-access-lsmgw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:07.743711 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.743563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:07.743711 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.743636 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:07.845123 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.845087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsmgw\" (UniqueName: \"kubernetes.io/projected/217189cc-2639-4778-8c92-8ee83e0524a0-kube-api-access-lsmgw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:07.845123 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.845124 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:07.845346 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.845147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:07.845449 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.845429 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:07.845517 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.845489 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:07.854033 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.854006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsmgw\" (UniqueName: \"kubernetes.io/projected/217189cc-2639-4778-8c92-8ee83e0524a0-kube-api-access-lsmgw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:07.991448 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:07.991373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:08.079694 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.079661 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb"] Jun 11 21:40:08.084094 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.084069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.091604 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.091577 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb"] Jun 11 21:40:08.148816 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.148791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7hzx\" (UniqueName: \"kubernetes.io/projected/2f4bf8d4-5693-4884-bbe1-de022072be6e-kube-api-access-m7hzx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.148924 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.148836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.148993 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.148913 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.181087 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.181064 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5"] Jun 11 21:40:08.183434 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:40:08.183410 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217189cc_2639_4778_8c92_8ee83e0524a0.slice/crio-8149b4801b7f6509bb02558f9938fdd1764a9fb86e9fc5b8999166df9319ea1c WatchSource:0}: Error finding container 8149b4801b7f6509bb02558f9938fdd1764a9fb86e9fc5b8999166df9319ea1c: Status 404 returned error can't find the container with id 8149b4801b7f6509bb02558f9938fdd1764a9fb86e9fc5b8999166df9319ea1c Jun 11 21:40:08.249741 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.249690 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.249832 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.249778 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7hzx\" (UniqueName: \"kubernetes.io/projected/2f4bf8d4-5693-4884-bbe1-de022072be6e-kube-api-access-m7hzx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.249832 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.249802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.250028 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.250010 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.250122 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.250103 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.257989 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.257968 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7hzx\" (UniqueName: \"kubernetes.io/projected/2f4bf8d4-5693-4884-bbe1-de022072be6e-kube-api-access-m7hzx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.325773 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.325734 2578 generic.go:356] "Generic (PLEG): container finished" podID="aae986bd-5918-41c7-b1a4-7f5ba4b2772c" containerID="280d24c043d948e377c4face935ec45a6e8b9262cacdbb1998e30604497dd5e0" exitCode=0 Jun 11 21:40:08.325944 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.325791 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" event={"ID":"aae986bd-5918-41c7-b1a4-7f5ba4b2772c","Type":"ContainerDied","Data":"280d24c043d948e377c4face935ec45a6e8b9262cacdbb1998e30604497dd5e0"} Jun 11 21:40:08.327486 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.327393 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" event={"ID":"217189cc-2639-4778-8c92-8ee83e0524a0","Type":"ContainerStarted","Data":"9fea830dcde40c452bb7cafe47ca436e516c0517742e2c0142865194b3dcfb4a"} Jun 11 21:40:08.327486 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.327433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" event={"ID":"217189cc-2639-4778-8c92-8ee83e0524a0","Type":"ContainerStarted","Data":"8149b4801b7f6509bb02558f9938fdd1764a9fb86e9fc5b8999166df9319ea1c"} Jun 11 21:40:08.329010 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.328988 2578 generic.go:356] "Generic (PLEG): container finished" podID="426d304b-afb6-40f0-a25e-2da8ae42aafa" containerID="1427db42881422b2c83006d9949349c887c81a09d1490fa0603fc5830479ba9a" exitCode=0 Jun 11 21:40:08.329166 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.329016 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" event={"ID":"426d304b-afb6-40f0-a25e-2da8ae42aafa","Type":"ContainerDied","Data":"1427db42881422b2c83006d9949349c887c81a09d1490fa0603fc5830479ba9a"} Jun 11 21:40:08.329166 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.329043 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" event={"ID":"426d304b-afb6-40f0-a25e-2da8ae42aafa","Type":"ContainerStarted","Data":"e55a5824bbdb3a35edca7a0e38fb4aea89994dcf437d494c07c6a2ad8391f997"} Jun 11 21:40:08.396576 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.396548 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:08.531328 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:08.531302 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb"] Jun 11 21:40:08.564442 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:40:08.564416 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4bf8d4_5693_4884_bbe1_de022072be6e.slice/crio-34666b2566b7769fa1c773fe3f679aafb4aaad9b18c1bad7b042204cf6cecefa WatchSource:0}: Error finding container 34666b2566b7769fa1c773fe3f679aafb4aaad9b18c1bad7b042204cf6cecefa: Status 404 returned error can't find the container with id 34666b2566b7769fa1c773fe3f679aafb4aaad9b18c1bad7b042204cf6cecefa Jun 11 21:40:09.336487 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:09.336457 2578 generic.go:356] "Generic (PLEG): container finished" podID="aae986bd-5918-41c7-b1a4-7f5ba4b2772c" containerID="eabb70ea875e9386b687f5ecefc7d22866b1d0e6b630482e99def44fc3c727ab" exitCode=0 Jun 11 21:40:09.338042 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:09.338018 2578 generic.go:356] "Generic (PLEG): container finished" podID="217189cc-2639-4778-8c92-8ee83e0524a0" containerID="9fea830dcde40c452bb7cafe47ca436e516c0517742e2c0142865194b3dcfb4a" exitCode=0 Jun 11 21:40:09.339856 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:09.339833 2578 generic.go:356] "Generic (PLEG): container finished" podID="426d304b-afb6-40f0-a25e-2da8ae42aafa" containerID="10234ae0ca1ac1a1fbd5a968902b018821602bd024a256ecdd0c37bda5180634" exitCode=0 Jun 11 21:40:09.340933 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:09.340909 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" event={"ID":"aae986bd-5918-41c7-b1a4-7f5ba4b2772c","Type":"ContainerDied","Data":"eabb70ea875e9386b687f5ecefc7d22866b1d0e6b630482e99def44fc3c727ab"} Jun 11 21:40:09.341050 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:09.340960 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" event={"ID":"217189cc-2639-4778-8c92-8ee83e0524a0","Type":"ContainerDied","Data":"9fea830dcde40c452bb7cafe47ca436e516c0517742e2c0142865194b3dcfb4a"} Jun 11 21:40:09.341050 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:09.340984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" event={"ID":"426d304b-afb6-40f0-a25e-2da8ae42aafa","Type":"ContainerDied","Data":"10234ae0ca1ac1a1fbd5a968902b018821602bd024a256ecdd0c37bda5180634"} Jun 11 21:40:09.341516 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:09.341470 2578 generic.go:356] "Generic (PLEG): container finished" podID="2f4bf8d4-5693-4884-bbe1-de022072be6e" containerID="bf86a2c9852c5c29494069a6d63278dee52f9b46fbe9543a5cc7c169c431048e" exitCode=0 Jun 11 21:40:09.341587 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:09.341553 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" event={"ID":"2f4bf8d4-5693-4884-bbe1-de022072be6e","Type":"ContainerDied","Data":"bf86a2c9852c5c29494069a6d63278dee52f9b46fbe9543a5cc7c169c431048e"} Jun 11 21:40:09.341642 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:09.341602 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" event={"ID":"2f4bf8d4-5693-4884-bbe1-de022072be6e","Type":"ContainerStarted","Data":"34666b2566b7769fa1c773fe3f679aafb4aaad9b18c1bad7b042204cf6cecefa"} Jun 11 21:40:10.351643 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.351612 2578 generic.go:356] "Generic (PLEG): container finished" podID="217189cc-2639-4778-8c92-8ee83e0524a0" containerID="10807840cd435e4f59605a45c68663b7e8058e9665653b190da8950fd2a519bc" exitCode=0 Jun 11 21:40:10.351643 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.351682 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" event={"ID":"217189cc-2639-4778-8c92-8ee83e0524a0","Type":"ContainerDied","Data":"10807840cd435e4f59605a45c68663b7e8058e9665653b190da8950fd2a519bc"} Jun 11 21:40:10.354138 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.354114 2578 generic.go:356] "Generic (PLEG): container finished" podID="426d304b-afb6-40f0-a25e-2da8ae42aafa" containerID="8219d284841bb31cfef9d56d7eab9637199a0dc0387cff52aae64b4bc6ef102f" exitCode=0 Jun 11 21:40:10.354231 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.354191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" event={"ID":"426d304b-afb6-40f0-a25e-2da8ae42aafa","Type":"ContainerDied","Data":"8219d284841bb31cfef9d56d7eab9637199a0dc0387cff52aae64b4bc6ef102f"} Jun 11 21:40:10.356297 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.356275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" event={"ID":"2f4bf8d4-5693-4884-bbe1-de022072be6e","Type":"ContainerStarted","Data":"ee39fc76fbc45c95c67c0dc8f0771cdd67d226fc4f866691558fe031beb73ba3"} Jun 11 21:40:10.484169 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.484144 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:10.571164 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.571108 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-bundle\") pod \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " Jun 11 21:40:10.571164 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.571139 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6nsg\" (UniqueName: \"kubernetes.io/projected/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-kube-api-access-x6nsg\") pod \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " Jun 11 21:40:10.571288 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.571188 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-util\") pod \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\" (UID: \"aae986bd-5918-41c7-b1a4-7f5ba4b2772c\") " Jun 11 21:40:10.571630 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.571600 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-bundle" (OuterVolumeSpecName: "bundle") pod "aae986bd-5918-41c7-b1a4-7f5ba4b2772c" (UID: "aae986bd-5918-41c7-b1a4-7f5ba4b2772c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:40:10.573103 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.573085 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-kube-api-access-x6nsg" (OuterVolumeSpecName: "kube-api-access-x6nsg") pod "aae986bd-5918-41c7-b1a4-7f5ba4b2772c" (UID: "aae986bd-5918-41c7-b1a4-7f5ba4b2772c"). InnerVolumeSpecName "kube-api-access-x6nsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:40:10.576686 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.576662 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-util" (OuterVolumeSpecName: "util") pod "aae986bd-5918-41c7-b1a4-7f5ba4b2772c" (UID: "aae986bd-5918-41c7-b1a4-7f5ba4b2772c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:40:10.671786 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.671752 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:10.671786 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.671782 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6nsg\" (UniqueName: \"kubernetes.io/projected/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-kube-api-access-x6nsg\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:10.671931 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:10.671795 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aae986bd-5918-41c7-b1a4-7f5ba4b2772c-util\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:11.362880 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.362851 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" Jun 11 21:40:11.363229 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.362854 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf" event={"ID":"aae986bd-5918-41c7-b1a4-7f5ba4b2772c","Type":"ContainerDied","Data":"0c5a4db5aa17618151729d27a2cb80085e2c709dc6f60480ee9efeaa245b34da"} Jun 11 21:40:11.363229 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.362967 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c5a4db5aa17618151729d27a2cb80085e2c709dc6f60480ee9efeaa245b34da" Jun 11 21:40:11.365097 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.365070 2578 generic.go:356] "Generic (PLEG): container finished" podID="217189cc-2639-4778-8c92-8ee83e0524a0" containerID="955310fb6a4e1624ce074238f43ad19b01cde47a3bd33883d8dd49b62f9389ef" exitCode=0 Jun 11 21:40:11.365441 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.365119 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" event={"ID":"217189cc-2639-4778-8c92-8ee83e0524a0","Type":"ContainerDied","Data":"955310fb6a4e1624ce074238f43ad19b01cde47a3bd33883d8dd49b62f9389ef"} Jun 11 21:40:11.367244 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.367221 2578 generic.go:356] "Generic (PLEG): container finished" podID="2f4bf8d4-5693-4884-bbe1-de022072be6e" containerID="ee39fc76fbc45c95c67c0dc8f0771cdd67d226fc4f866691558fe031beb73ba3" exitCode=0 Jun 11 21:40:11.367244 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.367240 2578 generic.go:356] "Generic (PLEG): container finished" podID="2f4bf8d4-5693-4884-bbe1-de022072be6e" containerID="c041e97064fbf9e49acfa762d58b10705ff796f1185c61f1367c74a10a141679" exitCode=0 Jun 11 21:40:11.367385 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.367299 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" event={"ID":"2f4bf8d4-5693-4884-bbe1-de022072be6e","Type":"ContainerDied","Data":"ee39fc76fbc45c95c67c0dc8f0771cdd67d226fc4f866691558fe031beb73ba3"} Jun 11 21:40:11.367385 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.367334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" event={"ID":"2f4bf8d4-5693-4884-bbe1-de022072be6e","Type":"ContainerDied","Data":"c041e97064fbf9e49acfa762d58b10705ff796f1185c61f1367c74a10a141679"} Jun 11 21:40:11.495480 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.495456 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:11.580324 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.580300 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-bundle\") pod \"426d304b-afb6-40f0-a25e-2da8ae42aafa\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " Jun 11 21:40:11.580458 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.580330 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss5hd\" (UniqueName: \"kubernetes.io/projected/426d304b-afb6-40f0-a25e-2da8ae42aafa-kube-api-access-ss5hd\") pod \"426d304b-afb6-40f0-a25e-2da8ae42aafa\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " Jun 11 21:40:11.580458 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.580363 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-util\") pod \"426d304b-afb6-40f0-a25e-2da8ae42aafa\" (UID: \"426d304b-afb6-40f0-a25e-2da8ae42aafa\") " Jun 11 21:40:11.580946 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.580920 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-bundle" (OuterVolumeSpecName: "bundle") pod "426d304b-afb6-40f0-a25e-2da8ae42aafa" (UID: "426d304b-afb6-40f0-a25e-2da8ae42aafa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:40:11.582330 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.582299 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/426d304b-afb6-40f0-a25e-2da8ae42aafa-kube-api-access-ss5hd" (OuterVolumeSpecName: "kube-api-access-ss5hd") pod "426d304b-afb6-40f0-a25e-2da8ae42aafa" (UID: "426d304b-afb6-40f0-a25e-2da8ae42aafa"). InnerVolumeSpecName "kube-api-access-ss5hd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:40:11.585916 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.585894 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-util" (OuterVolumeSpecName: "util") pod "426d304b-afb6-40f0-a25e-2da8ae42aafa" (UID: "426d304b-afb6-40f0-a25e-2da8ae42aafa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:40:11.681602 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.681541 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:11.681602 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.681564 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss5hd\" (UniqueName: \"kubernetes.io/projected/426d304b-afb6-40f0-a25e-2da8ae42aafa-kube-api-access-ss5hd\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:11.681602 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:11.681573 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/426d304b-afb6-40f0-a25e-2da8ae42aafa-util\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:12.374547 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.374511 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" Jun 11 21:40:12.375043 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.374538 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2" event={"ID":"426d304b-afb6-40f0-a25e-2da8ae42aafa","Type":"ContainerDied","Data":"e55a5824bbdb3a35edca7a0e38fb4aea89994dcf437d494c07c6a2ad8391f997"} Jun 11 21:40:12.375043 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.374588 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e55a5824bbdb3a35edca7a0e38fb4aea89994dcf437d494c07c6a2ad8391f997" Jun 11 21:40:12.523331 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.523310 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:12.525349 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.525333 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:12.588234 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.588212 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-bundle\") pod \"2f4bf8d4-5693-4884-bbe1-de022072be6e\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " Jun 11 21:40:12.588376 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.588242 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-bundle\") pod \"217189cc-2639-4778-8c92-8ee83e0524a0\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " Jun 11 21:40:12.588376 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.588287 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-util\") pod \"217189cc-2639-4778-8c92-8ee83e0524a0\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " Jun 11 21:40:12.588376 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.588317 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7hzx\" (UniqueName: \"kubernetes.io/projected/2f4bf8d4-5693-4884-bbe1-de022072be6e-kube-api-access-m7hzx\") pod \"2f4bf8d4-5693-4884-bbe1-de022072be6e\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " Jun 11 21:40:12.588376 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.588332 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-util\") pod \"2f4bf8d4-5693-4884-bbe1-de022072be6e\" (UID: \"2f4bf8d4-5693-4884-bbe1-de022072be6e\") " Jun 11 21:40:12.588599 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.588385 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsmgw\" (UniqueName: \"kubernetes.io/projected/217189cc-2639-4778-8c92-8ee83e0524a0-kube-api-access-lsmgw\") pod \"217189cc-2639-4778-8c92-8ee83e0524a0\" (UID: \"217189cc-2639-4778-8c92-8ee83e0524a0\") " Jun 11 21:40:12.588848 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.588822 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-bundle" (OuterVolumeSpecName: "bundle") pod "2f4bf8d4-5693-4884-bbe1-de022072be6e" (UID: "2f4bf8d4-5693-4884-bbe1-de022072be6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:40:12.588928 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.588867 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-bundle" (OuterVolumeSpecName: "bundle") pod "217189cc-2639-4778-8c92-8ee83e0524a0" (UID: "217189cc-2639-4778-8c92-8ee83e0524a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:40:12.590559 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.590529 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/217189cc-2639-4778-8c92-8ee83e0524a0-kube-api-access-lsmgw" (OuterVolumeSpecName: "kube-api-access-lsmgw") pod "217189cc-2639-4778-8c92-8ee83e0524a0" (UID: "217189cc-2639-4778-8c92-8ee83e0524a0"). InnerVolumeSpecName "kube-api-access-lsmgw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:40:12.590870 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.590846 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f4bf8d4-5693-4884-bbe1-de022072be6e-kube-api-access-m7hzx" (OuterVolumeSpecName: "kube-api-access-m7hzx") pod "2f4bf8d4-5693-4884-bbe1-de022072be6e" (UID: "2f4bf8d4-5693-4884-bbe1-de022072be6e"). InnerVolumeSpecName "kube-api-access-m7hzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:40:12.594709 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.594674 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-util" (OuterVolumeSpecName: "util") pod "2f4bf8d4-5693-4884-bbe1-de022072be6e" (UID: "2f4bf8d4-5693-4884-bbe1-de022072be6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:40:12.596484 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.596448 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-util" (OuterVolumeSpecName: "util") pod "217189cc-2639-4778-8c92-8ee83e0524a0" (UID: "217189cc-2639-4778-8c92-8ee83e0524a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:40:12.689293 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.689228 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsmgw\" (UniqueName: \"kubernetes.io/projected/217189cc-2639-4778-8c92-8ee83e0524a0-kube-api-access-lsmgw\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:12.689293 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.689252 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:12.689293 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.689262 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:12.689293 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.689269 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/217189cc-2639-4778-8c92-8ee83e0524a0-util\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:12.689293 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.689278 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7hzx\" (UniqueName: \"kubernetes.io/projected/2f4bf8d4-5693-4884-bbe1-de022072be6e-kube-api-access-m7hzx\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:12.689293 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:12.689286 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f4bf8d4-5693-4884-bbe1-de022072be6e-util\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:40:13.381162 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:13.381133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" event={"ID":"217189cc-2639-4778-8c92-8ee83e0524a0","Type":"ContainerDied","Data":"8149b4801b7f6509bb02558f9938fdd1764a9fb86e9fc5b8999166df9319ea1c"} Jun 11 21:40:13.381497 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:13.381177 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8149b4801b7f6509bb02558f9938fdd1764a9fb86e9fc5b8999166df9319ea1c" Jun 11 21:40:13.381497 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:13.381146 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5" Jun 11 21:40:13.383230 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:13.383208 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" Jun 11 21:40:13.383230 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:13.383218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb" event={"ID":"2f4bf8d4-5693-4884-bbe1-de022072be6e","Type":"ContainerDied","Data":"34666b2566b7769fa1c773fe3f679aafb4aaad9b18c1bad7b042204cf6cecefa"} Jun 11 21:40:13.383380 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:13.383270 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34666b2566b7769fa1c773fe3f679aafb4aaad9b18c1bad7b042204cf6cecefa" Jun 11 21:40:22.757081 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757048 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx"] Jun 11 21:40:22.757462 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757405 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="426d304b-afb6-40f0-a25e-2da8ae42aafa" containerName="extract" Jun 11 21:40:22.757462 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757417 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="426d304b-afb6-40f0-a25e-2da8ae42aafa" containerName="extract" Jun 11 21:40:22.757462 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757425 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="217189cc-2639-4778-8c92-8ee83e0524a0" containerName="pull" Jun 11 21:40:22.757462 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757430 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="217189cc-2639-4778-8c92-8ee83e0524a0" containerName="pull" Jun 11 21:40:22.757462 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757443 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f4bf8d4-5693-4884-bbe1-de022072be6e" containerName="util" Jun 11 21:40:22.757462 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757450 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f4bf8d4-5693-4884-bbe1-de022072be6e" containerName="util" Jun 11 21:40:22.757462 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757461 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f4bf8d4-5693-4884-bbe1-de022072be6e" containerName="extract" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757468 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f4bf8d4-5693-4884-bbe1-de022072be6e" containerName="extract" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757479 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="426d304b-afb6-40f0-a25e-2da8ae42aafa" containerName="util" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757484 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="426d304b-afb6-40f0-a25e-2da8ae42aafa" containerName="util" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757490 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="217189cc-2639-4778-8c92-8ee83e0524a0" containerName="util" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757495 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="217189cc-2639-4778-8c92-8ee83e0524a0" containerName="util" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757505 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae986bd-5918-41c7-b1a4-7f5ba4b2772c" containerName="extract" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757510 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae986bd-5918-41c7-b1a4-7f5ba4b2772c" containerName="extract" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757520 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae986bd-5918-41c7-b1a4-7f5ba4b2772c" containerName="pull" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757526 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae986bd-5918-41c7-b1a4-7f5ba4b2772c" containerName="pull" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757535 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="426d304b-afb6-40f0-a25e-2da8ae42aafa" containerName="pull" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757543 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="426d304b-afb6-40f0-a25e-2da8ae42aafa" containerName="pull" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757549 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f4bf8d4-5693-4884-bbe1-de022072be6e" containerName="pull" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757554 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f4bf8d4-5693-4884-bbe1-de022072be6e" containerName="pull" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757562 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae986bd-5918-41c7-b1a4-7f5ba4b2772c" containerName="util" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757567 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae986bd-5918-41c7-b1a4-7f5ba4b2772c" containerName="util" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757573 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="217189cc-2639-4778-8c92-8ee83e0524a0" containerName="extract" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757578 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="217189cc-2639-4778-8c92-8ee83e0524a0" containerName="extract" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757634 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="217189cc-2639-4778-8c92-8ee83e0524a0" containerName="extract" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757644 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae986bd-5918-41c7-b1a4-7f5ba4b2772c" containerName="extract" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757670 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="426d304b-afb6-40f0-a25e-2da8ae42aafa" containerName="extract" Jun 11 21:40:22.757704 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.757678 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f4bf8d4-5693-4884-bbe1-de022072be6e" containerName="extract" Jun 11 21:40:22.760467 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.760451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx" Jun 11 21:40:22.764123 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.764095 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9q4ml\"" Jun 11 21:40:22.764272 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.764258 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 21:40:22.777578 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.777552 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx"] Jun 11 21:40:22.868498 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.868469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzsl5\" (UniqueName: \"kubernetes.io/projected/2662fa92-7c99-4dff-92cd-6273e439a27b-kube-api-access-hzsl5\") pod \"dns-operator-controller-manager-864dd78c4c-9w8vx\" (UID: \"2662fa92-7c99-4dff-92cd-6273e439a27b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx" Jun 11 21:40:22.969514 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.969490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzsl5\" (UniqueName: \"kubernetes.io/projected/2662fa92-7c99-4dff-92cd-6273e439a27b-kube-api-access-hzsl5\") pod \"dns-operator-controller-manager-864dd78c4c-9w8vx\" (UID: \"2662fa92-7c99-4dff-92cd-6273e439a27b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx" Jun 11 21:40:22.979555 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:22.979530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzsl5\" (UniqueName: \"kubernetes.io/projected/2662fa92-7c99-4dff-92cd-6273e439a27b-kube-api-access-hzsl5\") pod \"dns-operator-controller-manager-864dd78c4c-9w8vx\" (UID: \"2662fa92-7c99-4dff-92cd-6273e439a27b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx" Jun 11 21:40:23.072048 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:23.072022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx" Jun 11 21:40:23.210376 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:23.210352 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx"] Jun 11 21:40:23.212768 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:40:23.212737 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2662fa92_7c99_4dff_92cd_6273e439a27b.slice/crio-d790f0ccf9eb5f192f6c81b60adf794fe1f49c95ee6523d1d2fe0e2b3ede5255 WatchSource:0}: Error finding container d790f0ccf9eb5f192f6c81b60adf794fe1f49c95ee6523d1d2fe0e2b3ede5255: Status 404 returned error can't find the container with id d790f0ccf9eb5f192f6c81b60adf794fe1f49c95ee6523d1d2fe0e2b3ede5255 Jun 11 21:40:23.436054 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:23.435959 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx" event={"ID":"2662fa92-7c99-4dff-92cd-6273e439a27b","Type":"ContainerStarted","Data":"d790f0ccf9eb5f192f6c81b60adf794fe1f49c95ee6523d1d2fe0e2b3ede5255"} Jun 11 21:40:26.153498 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.153421 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf"] Jun 11 21:40:26.156855 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.156839 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:40:26.160139 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.160117 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ttwzk\"" Jun 11 21:40:26.166963 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.166941 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf"] Jun 11 21:40:26.301478 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.301444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzhpm\" (UniqueName: \"kubernetes.io/projected/d620ecf2-0a5b-405a-8462-4dc9f4e2f231-kube-api-access-nzhpm\") pod \"limitador-operator-controller-manager-859d7b78bd-tsktf\" (UID: \"d620ecf2-0a5b-405a-8462-4dc9f4e2f231\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:40:26.402950 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.402909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzhpm\" (UniqueName: \"kubernetes.io/projected/d620ecf2-0a5b-405a-8462-4dc9f4e2f231-kube-api-access-nzhpm\") pod \"limitador-operator-controller-manager-859d7b78bd-tsktf\" (UID: \"d620ecf2-0a5b-405a-8462-4dc9f4e2f231\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:40:26.414797 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.414743 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzhpm\" (UniqueName: \"kubernetes.io/projected/d620ecf2-0a5b-405a-8462-4dc9f4e2f231-kube-api-access-nzhpm\") pod \"limitador-operator-controller-manager-859d7b78bd-tsktf\" (UID: \"d620ecf2-0a5b-405a-8462-4dc9f4e2f231\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:40:26.453624 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.453591 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx" event={"ID":"2662fa92-7c99-4dff-92cd-6273e439a27b","Type":"ContainerStarted","Data":"d94f59edb1fb9bf913ea31bb38bebc0266185bcbf92abef9f3e2ba84001626c6"} Jun 11 21:40:26.453786 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.453738 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx" Jun 11 21:40:26.467823 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.467802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:40:26.471823 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.471782 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx" podStartSLOduration=1.835916952 podStartE2EDuration="4.471769122s" totalImagesPullingTime="2.63585217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:40:26.470568628 +0000 UTC m=+769.618509777" watchObservedRunningTime="2026-06-11 21:40:26.471769122 +0000 UTC m=+769.619710272" Jun 11 21:40:26.613293 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:26.613002 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf"] Jun 11 21:40:26.616433 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:40:26.616401 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd620ecf2_0a5b_405a_8462_4dc9f4e2f231.slice/crio-30baaabfe7d19bef3460bd43e075f39fb7289249e884d9ede35afca7f624d098 WatchSource:0}: Error finding container 30baaabfe7d19bef3460bd43e075f39fb7289249e884d9ede35afca7f624d098: Status 404 returned error can't find the container with id 30baaabfe7d19bef3460bd43e075f39fb7289249e884d9ede35afca7f624d098 Jun 11 21:40:27.461675 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:27.461619 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" event={"ID":"d620ecf2-0a5b-405a-8462-4dc9f4e2f231","Type":"ContainerStarted","Data":"30baaabfe7d19bef3460bd43e075f39fb7289249e884d9ede35afca7f624d098"} Jun 11 21:40:28.468440 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:28.468406 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" event={"ID":"d620ecf2-0a5b-405a-8462-4dc9f4e2f231","Type":"ContainerStarted","Data":"5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b"} Jun 11 21:40:28.468827 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:28.468540 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:40:28.512670 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:28.501914 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" podStartSLOduration=0.801977102 podStartE2EDuration="2.501893831s" totalImagesPullingTime="1.699916729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:40:28.489334367 +0000 UTC m=+771.637275543" watchObservedRunningTime="2026-06-11 21:40:28.501893831 +0000 UTC m=+771.649834981" Jun 11 21:40:30.037479 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:30.037450 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p"] Jun 11 21:40:30.040903 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:30.040878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p" Jun 11 21:40:30.043872 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:30.043849 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xtk5c\"" Jun 11 21:40:30.051367 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:30.051342 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p"] Jun 11 21:40:30.134204 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:30.134174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qf4r\" (UniqueName: \"kubernetes.io/projected/b9d64488-dbfb-484e-8e47-7445b138039e-kube-api-access-6qf4r\") pod \"authorino-operator-75cc8d5cb7-cwx6p\" (UID: \"b9d64488-dbfb-484e-8e47-7445b138039e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p" Jun 11 21:40:30.235076 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:30.235044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qf4r\" (UniqueName: \"kubernetes.io/projected/b9d64488-dbfb-484e-8e47-7445b138039e-kube-api-access-6qf4r\") pod \"authorino-operator-75cc8d5cb7-cwx6p\" (UID: \"b9d64488-dbfb-484e-8e47-7445b138039e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p" Jun 11 21:40:30.243850 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:30.243826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qf4r\" (UniqueName: \"kubernetes.io/projected/b9d64488-dbfb-484e-8e47-7445b138039e-kube-api-access-6qf4r\") pod \"authorino-operator-75cc8d5cb7-cwx6p\" (UID: \"b9d64488-dbfb-484e-8e47-7445b138039e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p" Jun 11 21:40:30.351954 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:30.351873 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p" Jun 11 21:40:30.483495 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:30.483472 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p"] Jun 11 21:40:30.485115 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:40:30.485079 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d64488_dbfb_484e_8e47_7445b138039e.slice/crio-3fe0e0ff1deb81efbda0d7855cdd9fb1a53a0812ff1b93bd2e55321c2f9c2741 WatchSource:0}: Error finding container 3fe0e0ff1deb81efbda0d7855cdd9fb1a53a0812ff1b93bd2e55321c2f9c2741: Status 404 returned error can't find the container with id 3fe0e0ff1deb81efbda0d7855cdd9fb1a53a0812ff1b93bd2e55321c2f9c2741 Jun 11 21:40:31.487726 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:31.487688 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p" event={"ID":"b9d64488-dbfb-484e-8e47-7445b138039e","Type":"ContainerStarted","Data":"3fe0e0ff1deb81efbda0d7855cdd9fb1a53a0812ff1b93bd2e55321c2f9c2741"} Jun 11 21:40:33.500367 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:33.500329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p" event={"ID":"b9d64488-dbfb-484e-8e47-7445b138039e","Type":"ContainerStarted","Data":"e408128e7afc95caf3b9c3558c654541975f24ba2ba6382d22237b2236f10d40"} Jun 11 21:40:33.500836 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:33.500473 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p" Jun 11 21:40:33.520578 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:33.520534 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p" podStartSLOduration=1.284158443 podStartE2EDuration="3.520519849s" totalImagesPullingTime="2.236361406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:40:33.517891721 +0000 UTC m=+776.665832871" watchObservedRunningTime="2026-06-11 21:40:33.520519849 +0000 UTC m=+776.668460997" Jun 11 21:40:37.464273 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:37.464248 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9w8vx" Jun 11 21:40:39.476501 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:39.476471 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:40:44.511012 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:44.510979 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cwx6p" Jun 11 21:40:47.461810 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.461776 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5"] Jun 11 21:40:47.467194 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.467171 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:47.470012 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.469991 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 21:40:47.470138 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.469993 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2nz27\"" Jun 11 21:40:47.470138 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.469997 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 21:40:47.474549 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.474489 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5"] Jun 11 21:40:47.490864 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.490845 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74df9121-80c9-418f-87f7-dc43baf35f55-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6pcs5\" (UID: \"74df9121-80c9-418f-87f7-dc43baf35f55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:47.490961 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.490920 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxdz9\" (UniqueName: \"kubernetes.io/projected/74df9121-80c9-418f-87f7-dc43baf35f55-kube-api-access-qxdz9\") pod \"kuadrant-console-plugin-66b5774985-6pcs5\" (UID: \"74df9121-80c9-418f-87f7-dc43baf35f55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:47.490961 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.490939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74df9121-80c9-418f-87f7-dc43baf35f55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6pcs5\" (UID: \"74df9121-80c9-418f-87f7-dc43baf35f55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:47.591306 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.591274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74df9121-80c9-418f-87f7-dc43baf35f55-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6pcs5\" (UID: \"74df9121-80c9-418f-87f7-dc43baf35f55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:47.591469 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.591342 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxdz9\" (UniqueName: \"kubernetes.io/projected/74df9121-80c9-418f-87f7-dc43baf35f55-kube-api-access-qxdz9\") pod \"kuadrant-console-plugin-66b5774985-6pcs5\" (UID: \"74df9121-80c9-418f-87f7-dc43baf35f55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:47.591469 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.591367 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74df9121-80c9-418f-87f7-dc43baf35f55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6pcs5\" (UID: \"74df9121-80c9-418f-87f7-dc43baf35f55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:47.591552 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:40:47.591490 2578 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 21:40:47.591590 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:40:47.591561 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74df9121-80c9-418f-87f7-dc43baf35f55-plugin-serving-cert podName:74df9121-80c9-418f-87f7-dc43baf35f55 nodeName:}" failed. No retries permitted until 2026-06-11 21:40:48.091542716 +0000 UTC m=+791.239483853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/74df9121-80c9-418f-87f7-dc43baf35f55-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6pcs5" (UID: "74df9121-80c9-418f-87f7-dc43baf35f55") : secret "plugin-serving-cert" not found Jun 11 21:40:47.591975 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.591945 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/74df9121-80c9-418f-87f7-dc43baf35f55-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6pcs5\" (UID: \"74df9121-80c9-418f-87f7-dc43baf35f55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:47.601919 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:47.601900 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxdz9\" (UniqueName: \"kubernetes.io/projected/74df9121-80c9-418f-87f7-dc43baf35f55-kube-api-access-qxdz9\") pod \"kuadrant-console-plugin-66b5774985-6pcs5\" (UID: \"74df9121-80c9-418f-87f7-dc43baf35f55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:48.095920 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:48.095884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74df9121-80c9-418f-87f7-dc43baf35f55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6pcs5\" (UID: \"74df9121-80c9-418f-87f7-dc43baf35f55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:48.098406 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:48.098371 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/74df9121-80c9-418f-87f7-dc43baf35f55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6pcs5\" (UID: \"74df9121-80c9-418f-87f7-dc43baf35f55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:48.378041 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:48.377957 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" Jun 11 21:40:48.546784 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:48.546756 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5"] Jun 11 21:40:48.547687 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:40:48.547643 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74df9121_80c9_418f_87f7_dc43baf35f55.slice/crio-1d81d6584789c960be6084f8277fa1450f12ccd9544abc48ac438a21f59925fc WatchSource:0}: Error finding container 1d81d6584789c960be6084f8277fa1450f12ccd9544abc48ac438a21f59925fc: Status 404 returned error can't find the container with id 1d81d6584789c960be6084f8277fa1450f12ccd9544abc48ac438a21f59925fc Jun 11 21:40:48.580595 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:48.580566 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" event={"ID":"74df9121-80c9-418f-87f7-dc43baf35f55","Type":"ContainerStarted","Data":"1d81d6584789c960be6084f8277fa1450f12ccd9544abc48ac438a21f59925fc"} Jun 11 21:40:58.255000 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.251120 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf"] Jun 11 21:40:58.255000 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.251441 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" containerName="manager" containerID="cri-o://5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b" gracePeriod=2 Jun 11 21:40:58.256050 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:40:58.256012 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tsktf\" is forbidden: User \"system:node:ip-10-0-129-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-177.ec2.internal' and this object" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:40:58.261048 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.261020 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf"] Jun 11 21:40:58.276792 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.276760 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk"] Jun 11 21:40:58.277220 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.277200 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" containerName="manager" Jun 11 21:40:58.277220 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.277221 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" containerName="manager" Jun 11 21:40:58.277617 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.277327 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" containerName="manager" Jun 11 21:40:58.287421 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.287337 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk" Jun 11 21:40:58.293209 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:40:58.292049 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tsktf\" is forbidden: User \"system:node:ip-10-0-129-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-177.ec2.internal' and this object" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:40:58.296728 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.296702 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk"] Jun 11 21:40:58.381870 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.381838 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl6x7\" (UniqueName: \"kubernetes.io/projected/0e00fde5-df5e-4591-b63e-856fb664ec8d-kube-api-access-xl6x7\") pod \"limitador-operator-controller-manager-859d7b78bd-zw7pk\" (UID: \"0e00fde5-df5e-4591-b63e-856fb664ec8d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk" Jun 11 21:40:58.482801 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.482758 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl6x7\" (UniqueName: \"kubernetes.io/projected/0e00fde5-df5e-4591-b63e-856fb664ec8d-kube-api-access-xl6x7\") pod \"limitador-operator-controller-manager-859d7b78bd-zw7pk\" (UID: \"0e00fde5-df5e-4591-b63e-856fb664ec8d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk" Jun 11 21:40:58.491973 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.491944 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl6x7\" (UniqueName: \"kubernetes.io/projected/0e00fde5-df5e-4591-b63e-856fb664ec8d-kube-api-access-xl6x7\") pod \"limitador-operator-controller-manager-859d7b78bd-zw7pk\" (UID: \"0e00fde5-df5e-4591-b63e-856fb664ec8d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk" Jun 11 21:40:58.636491 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:40:58.636455 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk" Jun 11 21:41:10.675601 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.675573 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk"] Jun 11 21:41:10.676298 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.676279 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:41:10.678988 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:41:10.678961 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tsktf\" is forbidden: User \"system:node:ip-10-0-129-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-177.ec2.internal' and this object" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:41:10.685691 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:41:10.685668 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e00fde5_df5e_4591_b63e_856fb664ec8d.slice/crio-74716c4e233c43f9e722709c00f88cc32bbbf79d0cbe15dd75866a8cb1b4c540 WatchSource:0}: Error finding container 74716c4e233c43f9e722709c00f88cc32bbbf79d0cbe15dd75866a8cb1b4c540: Status 404 returned error can't find the container with id 74716c4e233c43f9e722709c00f88cc32bbbf79d0cbe15dd75866a8cb1b4c540 Jun 11 21:41:10.732489 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.732450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk" event={"ID":"0e00fde5-df5e-4591-b63e-856fb664ec8d","Type":"ContainerStarted","Data":"74716c4e233c43f9e722709c00f88cc32bbbf79d0cbe15dd75866a8cb1b4c540"} Jun 11 21:41:10.733959 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.733929 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" event={"ID":"74df9121-80c9-418f-87f7-dc43baf35f55","Type":"ContainerStarted","Data":"62c3a495664ac19f4ca7b921aaca6e5f5e7c55215644ea7301e58358f59c5996"} Jun 11 21:41:10.735155 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.735131 2578 generic.go:356] "Generic (PLEG): container finished" podID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" containerID="5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b" exitCode=0 Jun 11 21:41:10.735239 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.735168 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:41:10.735239 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.735195 2578 scope.go:117] "RemoveContainer" containerID="5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b" Jun 11 21:41:10.736310 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:41:10.736284 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tsktf\" is forbidden: User \"system:node:ip-10-0-129-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-177.ec2.internal' and this object" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:41:10.743034 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.743013 2578 scope.go:117] "RemoveContainer" containerID="5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b" Jun 11 21:41:10.743307 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:41:10.743285 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b\": container with ID starting with 5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b not found: ID does not exist" containerID="5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b" Jun 11 21:41:10.743389 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.743317 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b"} err="failed to get container status \"5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b\": rpc error: code = NotFound desc = could not find container \"5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b\": container with ID starting with 5f1cb1b114a1e541ff0b04862f8578d4a5cb3340d373769d9044f3eb2155672b not found: ID does not exist" Jun 11 21:41:10.754335 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.754294 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6pcs5" podStartSLOduration=1.675482439 podStartE2EDuration="23.754282065s" totalImagesPullingTime="22.078799626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:41:10.752715539 +0000 UTC m=+813.900656689" watchObservedRunningTime="2026-06-11 21:41:10.754282065 +0000 UTC m=+813.902223236" Jun 11 21:41:10.755239 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:41:10.755211 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tsktf\" is forbidden: User \"system:node:ip-10-0-129-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-177.ec2.internal' and this object" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:41:10.795209 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.795149 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzhpm\" (UniqueName: \"kubernetes.io/projected/d620ecf2-0a5b-405a-8462-4dc9f4e2f231-kube-api-access-nzhpm\") pod \"d620ecf2-0a5b-405a-8462-4dc9f4e2f231\" (UID: \"d620ecf2-0a5b-405a-8462-4dc9f4e2f231\") " Jun 11 21:41:10.796970 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.796947 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d620ecf2-0a5b-405a-8462-4dc9f4e2f231-kube-api-access-nzhpm" (OuterVolumeSpecName: "kube-api-access-nzhpm") pod "d620ecf2-0a5b-405a-8462-4dc9f4e2f231" (UID: "d620ecf2-0a5b-405a-8462-4dc9f4e2f231"). InnerVolumeSpecName "kube-api-access-nzhpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:41:10.896691 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:10.896634 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzhpm\" (UniqueName: \"kubernetes.io/projected/d620ecf2-0a5b-405a-8462-4dc9f4e2f231-kube-api-access-nzhpm\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:41:11.048602 ip-10-0-129-177 kubenswrapper[2578]: E0611 21:41:11.048527 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tsktf\" is forbidden: User \"system:node:ip-10-0-129-177.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-177.ec2.internal' and this object" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tsktf" Jun 11 21:41:11.341218 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:11.341140 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d620ecf2-0a5b-405a-8462-4dc9f4e2f231" path="/var/lib/kubelet/pods/d620ecf2-0a5b-405a-8462-4dc9f4e2f231/volumes" Jun 11 21:41:11.743189 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:11.743109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk" event={"ID":"0e00fde5-df5e-4591-b63e-856fb664ec8d","Type":"ContainerStarted","Data":"1dce888b2886c88129e6a693f7ed321d7c284d22347b10bae01fca6f21ebde38"} Jun 11 21:41:11.761039 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:11.760991 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk" podStartSLOduration=13.760978825 podStartE2EDuration="13.760978825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:40:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:41:11.759919236 +0000 UTC m=+814.907860401" watchObservedRunningTime="2026-06-11 21:41:11.760978825 +0000 UTC m=+814.908919973" Jun 11 21:41:12.748629 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:12.748605 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk" Jun 11 21:41:23.756026 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:23.755996 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-zw7pk" Jun 11 21:41:43.575379 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.575342 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wkz7p"] Jun 11 21:41:43.595359 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.595331 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wkz7p"] Jun 11 21:41:43.595498 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.595427 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:43.598642 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.598620 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 21:41:43.669785 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.669754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/684e8f3d-e4bb-4295-864e-9d3c6446486c-config-file\") pod \"limitador-limitador-64c94fd64f-wkz7p\" (UID: \"684e8f3d-e4bb-4295-864e-9d3c6446486c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:43.669969 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.669811 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnmbh\" (UniqueName: \"kubernetes.io/projected/684e8f3d-e4bb-4295-864e-9d3c6446486c-kube-api-access-rnmbh\") pod \"limitador-limitador-64c94fd64f-wkz7p\" (UID: \"684e8f3d-e4bb-4295-864e-9d3c6446486c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:43.674413 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.674383 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wkz7p"] Jun 11 21:41:43.770559 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.770510 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnmbh\" (UniqueName: \"kubernetes.io/projected/684e8f3d-e4bb-4295-864e-9d3c6446486c-kube-api-access-rnmbh\") pod \"limitador-limitador-64c94fd64f-wkz7p\" (UID: \"684e8f3d-e4bb-4295-864e-9d3c6446486c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:43.770753 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.770634 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/684e8f3d-e4bb-4295-864e-9d3c6446486c-config-file\") pod \"limitador-limitador-64c94fd64f-wkz7p\" (UID: \"684e8f3d-e4bb-4295-864e-9d3c6446486c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:43.771322 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.771297 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/684e8f3d-e4bb-4295-864e-9d3c6446486c-config-file\") pod \"limitador-limitador-64c94fd64f-wkz7p\" (UID: \"684e8f3d-e4bb-4295-864e-9d3c6446486c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:43.779744 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.779703 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnmbh\" (UniqueName: \"kubernetes.io/projected/684e8f3d-e4bb-4295-864e-9d3c6446486c-kube-api-access-rnmbh\") pod \"limitador-limitador-64c94fd64f-wkz7p\" (UID: \"684e8f3d-e4bb-4295-864e-9d3c6446486c\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:43.906202 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:43.906127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:44.038717 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:44.038572 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wkz7p"] Jun 11 21:41:44.041569 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:41:44.041542 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684e8f3d_e4bb_4295_864e_9d3c6446486c.slice/crio-c1468a339a829226da557506d244dd6b7d22b0af7d8d3f95178a5bbe7bd30bf7 WatchSource:0}: Error finding container c1468a339a829226da557506d244dd6b7d22b0af7d8d3f95178a5bbe7bd30bf7: Status 404 returned error can't find the container with id c1468a339a829226da557506d244dd6b7d22b0af7d8d3f95178a5bbe7bd30bf7 Jun 11 21:41:44.932266 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:44.932225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" event={"ID":"684e8f3d-e4bb-4295-864e-9d3c6446486c","Type":"ContainerStarted","Data":"c1468a339a829226da557506d244dd6b7d22b0af7d8d3f95178a5bbe7bd30bf7"} Jun 11 21:41:46.948999 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:46.948914 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" event={"ID":"684e8f3d-e4bb-4295-864e-9d3c6446486c","Type":"ContainerStarted","Data":"d4be06187acbfb903a07e2ca04aa993d49be04ff871ece85e1701ce8079383e1"} Jun 11 21:41:46.949355 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:46.949008 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:46.965929 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:46.965874 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" podStartSLOduration=1.326380166 podStartE2EDuration="3.965858888s" totalImagesPullingTime="2.639478722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:41:46.965219796 +0000 UTC m=+850.113160946" watchObservedRunningTime="2026-06-11 21:41:46.965858888 +0000 UTC m=+850.113800037" Jun 11 21:41:57.955396 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:57.955365 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:58.349573 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:58.349535 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wkz7p"] Jun 11 21:41:58.349763 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:58.349726 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" podUID="684e8f3d-e4bb-4295-864e-9d3c6446486c" containerName="limitador" containerID="cri-o://d4be06187acbfb903a07e2ca04aa993d49be04ff871ece85e1701ce8079383e1" gracePeriod=30 Jun 11 21:41:59.013302 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:59.013272 2578 generic.go:356] "Generic (PLEG): container finished" podID="684e8f3d-e4bb-4295-864e-9d3c6446486c" containerID="d4be06187acbfb903a07e2ca04aa993d49be04ff871ece85e1701ce8079383e1" exitCode=0 Jun 11 21:41:59.013682 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:59.013344 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" event={"ID":"684e8f3d-e4bb-4295-864e-9d3c6446486c","Type":"ContainerDied","Data":"d4be06187acbfb903a07e2ca04aa993d49be04ff871ece85e1701ce8079383e1"} Jun 11 21:41:59.303183 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:59.303126 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:41:59.405836 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:59.405805 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnmbh\" (UniqueName: \"kubernetes.io/projected/684e8f3d-e4bb-4295-864e-9d3c6446486c-kube-api-access-rnmbh\") pod \"684e8f3d-e4bb-4295-864e-9d3c6446486c\" (UID: \"684e8f3d-e4bb-4295-864e-9d3c6446486c\") " Jun 11 21:41:59.406023 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:59.405874 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/684e8f3d-e4bb-4295-864e-9d3c6446486c-config-file\") pod \"684e8f3d-e4bb-4295-864e-9d3c6446486c\" (UID: \"684e8f3d-e4bb-4295-864e-9d3c6446486c\") " Jun 11 21:41:59.406257 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:59.406233 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/684e8f3d-e4bb-4295-864e-9d3c6446486c-config-file" (OuterVolumeSpecName: "config-file") pod "684e8f3d-e4bb-4295-864e-9d3c6446486c" (UID: "684e8f3d-e4bb-4295-864e-9d3c6446486c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:41:59.408029 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:59.408004 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/684e8f3d-e4bb-4295-864e-9d3c6446486c-kube-api-access-rnmbh" (OuterVolumeSpecName: "kube-api-access-rnmbh") pod "684e8f3d-e4bb-4295-864e-9d3c6446486c" (UID: "684e8f3d-e4bb-4295-864e-9d3c6446486c"). InnerVolumeSpecName "kube-api-access-rnmbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:41:59.507187 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:59.507154 2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/684e8f3d-e4bb-4295-864e-9d3c6446486c-config-file\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:41:59.507187 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:41:59.507182 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnmbh\" (UniqueName: \"kubernetes.io/projected/684e8f3d-e4bb-4295-864e-9d3c6446486c-kube-api-access-rnmbh\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jun 11 21:42:00.020730 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:00.020698 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" Jun 11 21:42:00.020730 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:00.020714 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wkz7p" event={"ID":"684e8f3d-e4bb-4295-864e-9d3c6446486c","Type":"ContainerDied","Data":"c1468a339a829226da557506d244dd6b7d22b0af7d8d3f95178a5bbe7bd30bf7"} Jun 11 21:42:00.021234 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:00.020780 2578 scope.go:117] "RemoveContainer" containerID="d4be06187acbfb903a07e2ca04aa993d49be04ff871ece85e1701ce8079383e1" Jun 11 21:42:00.042791 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:00.042766 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wkz7p"] Jun 11 21:42:00.046289 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:00.046263 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wkz7p"] Jun 11 21:42:01.341077 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:01.341044 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="684e8f3d-e4bb-4295-864e-9d3c6446486c" path="/var/lib/kubelet/pods/684e8f3d-e4bb-4295-864e-9d3c6446486c/volumes" Jun 11 21:42:01.874638 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:01.874606 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-vlhvc"] Jun 11 21:42:01.875054 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:01.875034 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="684e8f3d-e4bb-4295-864e-9d3c6446486c" containerName="limitador" Jun 11 21:42:01.875130 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:01.875055 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="684e8f3d-e4bb-4295-864e-9d3c6446486c" containerName="limitador" Jun 11 21:42:01.875130 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:01.875127 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="684e8f3d-e4bb-4295-864e-9d3c6446486c" containerName="limitador" Jun 11 21:42:01.879041 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:01.879026 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vlhvc" Jun 11 21:42:01.882041 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:01.881994 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 21:42:01.886333 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:01.886308 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vlhvc"] Jun 11 21:42:01.927528 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:01.927505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/944bf656-4266-4c70-9c23-3db59fbc033d-data\") pod \"postgres-69fb4594cf-vlhvc\" (UID: \"944bf656-4266-4c70-9c23-3db59fbc033d\") " pod="opendatahub/postgres-69fb4594cf-vlhvc" Jun 11 21:42:01.927676 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:01.927560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5dmb\" (UniqueName: \"kubernetes.io/projected/944bf656-4266-4c70-9c23-3db59fbc033d-kube-api-access-z5dmb\") pod \"postgres-69fb4594cf-vlhvc\" (UID: \"944bf656-4266-4c70-9c23-3db59fbc033d\") " pod="opendatahub/postgres-69fb4594cf-vlhvc" Jun 11 21:42:02.028909 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:02.028883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/944bf656-4266-4c70-9c23-3db59fbc033d-data\") pod \"postgres-69fb4594cf-vlhvc\" (UID: \"944bf656-4266-4c70-9c23-3db59fbc033d\") " pod="opendatahub/postgres-69fb4594cf-vlhvc" Jun 11 21:42:02.029066 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:02.028936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5dmb\" (UniqueName: \"kubernetes.io/projected/944bf656-4266-4c70-9c23-3db59fbc033d-kube-api-access-z5dmb\") pod \"postgres-69fb4594cf-vlhvc\" (UID: \"944bf656-4266-4c70-9c23-3db59fbc033d\") " pod="opendatahub/postgres-69fb4594cf-vlhvc" Jun 11 21:42:02.029236 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:02.029219 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/944bf656-4266-4c70-9c23-3db59fbc033d-data\") pod \"postgres-69fb4594cf-vlhvc\" (UID: \"944bf656-4266-4c70-9c23-3db59fbc033d\") " pod="opendatahub/postgres-69fb4594cf-vlhvc" Jun 11 21:42:02.037196 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:02.037166 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5dmb\" (UniqueName: \"kubernetes.io/projected/944bf656-4266-4c70-9c23-3db59fbc033d-kube-api-access-z5dmb\") pod \"postgres-69fb4594cf-vlhvc\" (UID: \"944bf656-4266-4c70-9c23-3db59fbc033d\") " pod="opendatahub/postgres-69fb4594cf-vlhvc" Jun 11 21:42:02.191599 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:02.191508 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vlhvc" Jun 11 21:42:02.326153 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:02.326124 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vlhvc"] Jun 11 21:42:02.327739 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:42:02.327709 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944bf656_4266_4c70_9c23_3db59fbc033d.slice/crio-2c1c02e14229b754e6a1bef0a57332af068504e900c288870e1b1ef2e42cfe1a WatchSource:0}: Error finding container 2c1c02e14229b754e6a1bef0a57332af068504e900c288870e1b1ef2e42cfe1a: Status 404 returned error can't find the container with id 2c1c02e14229b754e6a1bef0a57332af068504e900c288870e1b1ef2e42cfe1a Jun 11 21:42:03.038132 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:03.038089 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vlhvc" event={"ID":"944bf656-4266-4c70-9c23-3db59fbc033d","Type":"ContainerStarted","Data":"2c1c02e14229b754e6a1bef0a57332af068504e900c288870e1b1ef2e42cfe1a"} Jun 11 21:42:05.051602 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:05.051561 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vlhvc" event={"ID":"944bf656-4266-4c70-9c23-3db59fbc033d","Type":"ContainerStarted","Data":"8de8cbbd8ee5cc49e413283a637d708775f8221fe5672012cce4cbf3293fc1ae"} Jun 11 21:42:05.052035 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:05.051707 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-vlhvc" Jun 11 21:42:05.067539 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:05.067494 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-vlhvc" podStartSLOduration=1.7301259949999999 podStartE2EDuration="4.067480057s" totalImagesPullingTime="2.337354062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:05.066492497 +0000 UTC m=+868.214433639" watchObservedRunningTime="2026-06-11 21:42:05.067480057 +0000 UTC m=+868.215421206" Jun 11 21:42:05.330070 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:05.329990 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d6d9f9d7c-cbkjs_60e0c668-a37c-4c25-bd10-54aa2fe4ccbc/nginx/0.log" Jun 11 21:42:06.234991 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:06.234964 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx_80a17c70-4132-4c95-9179-d42d78d8f897/copy-manifests/0.log" Jun 11 21:42:06.242042 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:06.242018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx_80a17c70-4132-4c95-9179-d42d78d8f897/manager/0.log" Jun 11 21:42:06.351442 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:06.351413 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vlhvc_944bf656-4266-4c70-9c23-3db59fbc033d/postgres/0.log" Jun 11 21:42:06.996052 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:06.996021 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf_aae986bd-5918-41c7-b1a4-7f5ba4b2772c/util/0.log" Jun 11 21:42:07.002685 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.002640 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf_aae986bd-5918-41c7-b1a4-7f5ba4b2772c/pull/0.log" Jun 11 21:42:07.008867 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.008848 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf_aae986bd-5918-41c7-b1a4-7f5ba4b2772c/extract/0.log" Jun 11 21:42:07.111988 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.111964 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb_2f4bf8d4-5693-4884-bbe1-de022072be6e/extract/0.log" Jun 11 21:42:07.117878 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.117856 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb_2f4bf8d4-5693-4884-bbe1-de022072be6e/util/0.log" Jun 11 21:42:07.123956 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.123934 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb_2f4bf8d4-5693-4884-bbe1-de022072be6e/pull/0.log" Jun 11 21:42:07.235440 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.235407 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2_426d304b-afb6-40f0-a25e-2da8ae42aafa/pull/0.log" Jun 11 21:42:07.242449 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.242425 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2_426d304b-afb6-40f0-a25e-2da8ae42aafa/extract/0.log" Jun 11 21:42:07.249435 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.249385 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2_426d304b-afb6-40f0-a25e-2da8ae42aafa/util/0.log" Jun 11 21:42:07.353831 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.353805 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5_217189cc-2639-4778-8c92-8ee83e0524a0/util/0.log" Jun 11 21:42:07.362325 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.362293 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5_217189cc-2639-4778-8c92-8ee83e0524a0/pull/0.log" Jun 11 21:42:07.368557 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.368539 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5_217189cc-2639-4778-8c92-8ee83e0524a0/extract/0.log" Jun 11 21:42:07.586962 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.586918 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cwx6p_b9d64488-dbfb-484e-8e47-7445b138039e/manager/0.log" Jun 11 21:42:07.707999 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.707973 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9w8vx_2662fa92-7c99-4dff-92cd-6273e439a27b/manager/0.log" Jun 11 21:42:07.814483 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.814457 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6pcs5_74df9121-80c9-418f-87f7-dc43baf35f55/kuadrant-console-plugin/0.log" Jun 11 21:42:07.922108 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:07.922039 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t47n5_6a9af54e-370a-46c8-899a-809e6ae453c6/registry-server/0.log" Jun 11 21:42:08.262484 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:08.262463 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zw7pk_0e00fde5-df5e-4591-b63e-856fb664ec8d/manager/0.log" Jun 11 21:42:08.610219 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:08.610146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xh9p4_97f66e97-769f-428e-9b6e-2d2b5c57128f/istio-proxy/0.log" Jun 11 21:42:09.172356 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:09.172328 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd9d485dd-lrv8r_c172843b-7283-481f-a7b9-bb5378f186c6/router/0.log" Jun 11 21:42:11.093928 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:11.093903 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-vlhvc" Jun 11 21:42:15.965098 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:15.965018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b8b29_38176311-61fa-4cea-9fbf-258415da1d0f/global-pull-secret-syncer/0.log" Jun 11 21:42:16.147456 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:16.147427 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zjcsl_2c0a27a5-7204-4798-998b-e1e2c1d199ed/konnectivity-agent/0.log" Jun 11 21:42:16.168212 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:16.168182 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-177.ec2.internal_5c49f7a7525b890c85efe14ae9aca6d6/haproxy/0.log" Jun 11 21:42:20.821097 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:20.821068 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf_aae986bd-5918-41c7-b1a4-7f5ba4b2772c/extract/0.log" Jun 11 21:42:20.859377 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:20.859316 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf_aae986bd-5918-41c7-b1a4-7f5ba4b2772c/util/0.log" Jun 11 21:42:20.884159 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:20.884132 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75998rkf_aae986bd-5918-41c7-b1a4-7f5ba4b2772c/pull/0.log" Jun 11 21:42:20.911013 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:20.910990 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb_2f4bf8d4-5693-4884-bbe1-de022072be6e/extract/0.log" Jun 11 21:42:20.929635 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:20.929616 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb_2f4bf8d4-5693-4884-bbe1-de022072be6e/util/0.log" Jun 11 21:42:20.950050 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:20.950031 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xf2gb_2f4bf8d4-5693-4884-bbe1-de022072be6e/pull/0.log" Jun 11 21:42:20.985221 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:20.985200 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2_426d304b-afb6-40f0-a25e-2da8ae42aafa/extract/0.log" Jun 11 21:42:21.009166 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:21.009146 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2_426d304b-afb6-40f0-a25e-2da8ae42aafa/util/0.log" Jun 11 21:42:21.033061 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:21.033042 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732dzj2_426d304b-afb6-40f0-a25e-2da8ae42aafa/pull/0.log" Jun 11 21:42:21.076951 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:21.076931 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5_217189cc-2639-4778-8c92-8ee83e0524a0/extract/0.log" Jun 11 21:42:21.105638 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:21.105622 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5_217189cc-2639-4778-8c92-8ee83e0524a0/util/0.log" Jun 11 21:42:21.126019 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:21.125969 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lfmc5_217189cc-2639-4778-8c92-8ee83e0524a0/pull/0.log" Jun 11 21:42:21.180499 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:21.180478 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cwx6p_b9d64488-dbfb-484e-8e47-7445b138039e/manager/0.log" Jun 11 21:42:21.227261 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:21.227242 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9w8vx_2662fa92-7c99-4dff-92cd-6273e439a27b/manager/0.log" Jun 11 21:42:21.256282 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:21.256264 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6pcs5_74df9121-80c9-418f-87f7-dc43baf35f55/kuadrant-console-plugin/0.log" Jun 11 21:42:21.282842 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:21.282824 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t47n5_6a9af54e-370a-46c8-899a-809e6ae453c6/registry-server/0.log" Jun 11 21:42:21.367099 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:21.367074 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-zw7pk_0e00fde5-df5e-4591-b63e-856fb664ec8d/manager/0.log" Jun 11 21:42:23.244545 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:23.244515 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-fcnkc_9c400a8c-ef0c-4525-9016-73a000d7f1ca/cluster-monitoring-operator/0.log" Jun 11 21:42:23.274263 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:23.274231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-h2bbb_3d59257b-de44-48b0-b41d-13b50732b521/kube-state-metrics/0.log" Jun 11 21:42:23.292501 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:23.292481 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-h2bbb_3d59257b-de44-48b0-b41d-13b50732b521/kube-rbac-proxy-main/0.log" Jun 11 21:42:23.313161 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:23.313140 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-h2bbb_3d59257b-de44-48b0-b41d-13b50732b521/kube-rbac-proxy-self/0.log" Jun 11 21:42:23.339367 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:23.339349 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7776c7cb6f-pdnhk_8227700d-9984-4afd-9c05-43986a9b3968/metrics-server/0.log" Jun 11 21:42:23.363536 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:23.363510 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-m6dbr_061f56fc-167c-40b4-b4cd-2fb63d818e8c/monitoring-plugin/0.log" Jun 11 21:42:23.543188 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:23.543164 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n22ft_cb731c62-5d8c-40c3-989c-5f4cf5f09a6e/node-exporter/0.log" Jun 11 21:42:23.564625 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:23.564605 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n22ft_cb731c62-5d8c-40c3-989c-5f4cf5f09a6e/kube-rbac-proxy/0.log" Jun 11 21:42:23.590008 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:23.589989 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n22ft_cb731c62-5d8c-40c3-989c-5f4cf5f09a6e/init-textfile/0.log" Jun 11 21:42:24.134834 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:24.134764 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/thanos-query/0.log" Jun 11 21:42:24.158422 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:24.158400 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/kube-rbac-proxy-web/0.log" Jun 11 21:42:24.176153 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:24.176128 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/kube-rbac-proxy/0.log" Jun 11 21:42:24.196331 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:24.196308 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/prom-label-proxy/0.log" Jun 11 21:42:24.215886 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:24.215869 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/kube-rbac-proxy-rules/0.log" Jun 11 21:42:24.237863 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:24.237846 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cc5ccdfb6-ct8s8_ba0102a6-45e9-4f47-b5dc-b1113b7924bc/kube-rbac-proxy-metrics/0.log" Jun 11 21:42:27.002757 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.002729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6576b864d8-8h5jg_71bf7f50-9cd9-4e85-ae56-af74cfa23be0/console/0.log" Jun 11 21:42:27.686133 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.686101 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs"] Jun 11 21:42:27.689743 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.689722 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.693106 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.693083 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hlp98\"/\"default-dockercfg-sqnbv\"" Jun 11 21:42:27.694169 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.694147 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hlp98\"/\"openshift-service-ca.crt\"" Jun 11 21:42:27.694256 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.694155 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hlp98\"/\"kube-root-ca.crt\"" Jun 11 21:42:27.699292 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.699272 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs"] Jun 11 21:42:27.759268 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.759236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftk92\" (UniqueName: \"kubernetes.io/projected/e9a68357-c2c9-4ec5-9297-4498f2cec62d-kube-api-access-ftk92\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.759413 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.759278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-sys\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.759413 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.759293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-proc\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.759413 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.759311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-podres\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.759413 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.759367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-lib-modules\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.860820 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.860788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-lib-modules\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.860958 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.860873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftk92\" (UniqueName: \"kubernetes.io/projected/e9a68357-c2c9-4ec5-9297-4498f2cec62d-kube-api-access-ftk92\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.860958 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.860908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-sys\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.860958 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.860923 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-proc\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.860958 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.860941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-podres\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.861110 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.860960 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-lib-modules\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.861110 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.861008 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-proc\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.861110 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.861005 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-sys\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.861110 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.861035 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e9a68357-c2c9-4ec5-9297-4498f2cec62d-podres\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:27.870032 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:27.870012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftk92\" (UniqueName: \"kubernetes.io/projected/e9a68357-c2c9-4ec5-9297-4498f2cec62d-kube-api-access-ftk92\") pod \"perf-node-gather-daemonset-c7cbs\" (UID: \"e9a68357-c2c9-4ec5-9297-4498f2cec62d\") " pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:28.001700 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:28.001631 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:28.133264 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:28.133230 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs"] Jun 11 21:42:28.134754 ip-10-0-129-177 kubenswrapper[2578]: W0611 21:42:28.134726 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode9a68357_c2c9_4ec5_9297_4498f2cec62d.slice/crio-fbdc272c69f2b0c207faf9171e4f8b341047ef1635295d869c954032e0c0f4e6 WatchSource:0}: Error finding container fbdc272c69f2b0c207faf9171e4f8b341047ef1635295d869c954032e0c0f4e6: Status 404 returned error can't find the container with id fbdc272c69f2b0c207faf9171e4f8b341047ef1635295d869c954032e0c0f4e6 Jun 11 21:42:28.181535 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:28.181510 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" event={"ID":"e9a68357-c2c9-4ec5-9297-4498f2cec62d","Type":"ContainerStarted","Data":"fbdc272c69f2b0c207faf9171e4f8b341047ef1635295d869c954032e0c0f4e6"} Jun 11 21:42:29.055394 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:29.055340 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jnqmc_b4131642-3181-49b5-a6ff-e144ceae9785/dns/0.log" Jun 11 21:42:29.075366 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:29.075345 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jnqmc_b4131642-3181-49b5-a6ff-e144ceae9785/kube-rbac-proxy/0.log" Jun 11 21:42:29.118318 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:29.118298 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-965jb_a1fffbaa-28f7-47d8-b5db-a8e7dbee2f23/dns-node-resolver/0.log" Jun 11 21:42:29.188424 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:29.188396 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" event={"ID":"e9a68357-c2c9-4ec5-9297-4498f2cec62d","Type":"ContainerStarted","Data":"0596c6ce3c0dbcff354d9ab01183c557a21221a8e13b957f9a8f3a35daac2edf"} Jun 11 21:42:29.188817 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:29.188537 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:29.205012 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:29.204964 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" podStartSLOduration=2.20494875 podStartE2EDuration="2.20494875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:42:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:42:29.203833431 +0000 UTC m=+892.351774579" watchObservedRunningTime="2026-06-11 21:42:29.20494875 +0000 UTC m=+892.352889906" Jun 11 21:42:29.658804 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:29.658777 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bsx4x_d06fa857-a932-4daf-b686-a0e47fbc56cc/node-ca/0.log" Jun 11 21:42:30.586635 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:30.586609 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xh9p4_97f66e97-769f-428e-9b6e-2d2b5c57128f/istio-proxy/0.log" Jun 11 21:42:30.721285 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:30.721258 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd9d485dd-lrv8r_c172843b-7283-481f-a7b9-bb5378f186c6/router/0.log" Jun 11 21:42:31.325283 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:31.325252 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w4slm_26373a4a-7b9f-4023-bf1e-71e354fe85e4/serve-healthcheck-canary/0.log" Jun 11 21:42:31.799165 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:31.799136 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-8tk5t_76228efd-e9f7-4877-a884-462c175462bd/insights-operator/0.log" Jun 11 21:42:31.800696 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:31.800668 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-8tk5t_76228efd-e9f7-4877-a884-462c175462bd/insights-operator/1.log" Jun 11 21:42:31.957705 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:31.957677 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8fbp_c2d5e55e-1604-4d52-bda6-9a32b996b339/kube-rbac-proxy/0.log" Jun 11 21:42:31.977031 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:31.977008 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8fbp_c2d5e55e-1604-4d52-bda6-9a32b996b339/exporter/0.log" Jun 11 21:42:31.997073 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:31.997047 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8fbp_c2d5e55e-1604-4d52-bda6-9a32b996b339/extractor/0.log" Jun 11 21:42:34.136819 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:34.136789 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d6d9f9d7c-cbkjs_60e0c668-a37c-4c25-bd10-54aa2fe4ccbc/nginx/0.log" Jun 11 21:42:34.388361 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:34.388285 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx_80a17c70-4132-4c95-9179-d42d78d8f897/manager/0.log" Jun 11 21:42:34.407498 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:34.407471 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc8bccbdb-zn5rx_80a17c70-4132-4c95-9179-d42d78d8f897/copy-manifests/0.log" Jun 11 21:42:34.430262 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:34.430239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vlhvc_944bf656-4266-4c70-9c23-3db59fbc033d/postgres/0.log" Jun 11 21:42:35.203313 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:35.203282 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hlp98/perf-node-gather-daemonset-c7cbs" Jun 11 21:42:35.699944 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:35.699915 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7cc86d56d6-scf4w_562de15a-cf4f-4888-8f25-e62910c377a2/manager/0.log" Jun 11 21:42:37.360111 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:37.360071 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:42:37.361453 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:37.361432 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:42:41.823004 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:41.822941 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xh9p4_97f66e97-769f-428e-9b6e-2d2b5c57128f/istio-proxy/0.log" Jun 11 21:42:41.926512 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:41.926477 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd9d485dd-lrv8r_c172843b-7283-481f-a7b9-bb5378f186c6/router/0.log" Jun 11 21:42:42.886627 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:42.886604 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xh9p4_97f66e97-769f-428e-9b6e-2d2b5c57128f/istio-proxy/0.log" Jun 11 21:42:42.950432 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:42.950406 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z7k92_ba81491f-9a23-4ab5-9874-72a3829459d5/kube-multus-additional-cni-plugins/0.log" Jun 11 21:42:42.970187 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:42.970163 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z7k92_ba81491f-9a23-4ab5-9874-72a3829459d5/egress-router-binary-copy/0.log" Jun 11 21:42:42.974005 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:42.973990 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd9d485dd-lrv8r_c172843b-7283-481f-a7b9-bb5378f186c6/router/0.log" Jun 11 21:42:42.993243 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:42.993223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z7k92_ba81491f-9a23-4ab5-9874-72a3829459d5/cni-plugins/0.log" Jun 11 21:42:43.013035 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:43.013018 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z7k92_ba81491f-9a23-4ab5-9874-72a3829459d5/bond-cni-plugin/0.log" Jun 11 21:42:43.033124 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:43.033109 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z7k92_ba81491f-9a23-4ab5-9874-72a3829459d5/routeoverride-cni/0.log" Jun 11 21:42:43.054968 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:43.054949 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z7k92_ba81491f-9a23-4ab5-9874-72a3829459d5/whereabouts-cni-bincopy/0.log" Jun 11 21:42:43.075380 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:43.075360 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z7k92_ba81491f-9a23-4ab5-9874-72a3829459d5/whereabouts-cni/0.log" Jun 11 21:42:43.104904 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:43.104882 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jpsm4_10fc3aab-3208-41f0-abb4-40f376cb9cec/kube-multus/0.log" Jun 11 21:42:43.174450 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:43.174399 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4t9th_050b45ae-ece1-41ae-a59b-f8f81db2cf7e/network-metrics-daemon/0.log" Jun 11 21:42:43.194692 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:43.194674 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4t9th_050b45ae-ece1-41ae-a59b-f8f81db2cf7e/kube-rbac-proxy/0.log" Jun 11 21:42:44.208468 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.208436 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-controller/0.log" Jun 11 21:42:44.225631 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.225609 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/1.log" Jun 11 21:42:44.225812 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.225641 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovn-acl-logging/0.log" Jun 11 21:42:44.244548 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.244525 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/kube-rbac-proxy-node/0.log" Jun 11 21:42:44.264084 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.264061 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 21:42:44.281539 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.281521 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/northd/0.log" Jun 11 21:42:44.300322 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.300306 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/nbdb/0.log" Jun 11 21:42:44.318897 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.318881 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/sbdb/0.log" Jun 11 21:42:44.360909 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.360886 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dfnmq_6add5816-4e1b-45b7-822d-e1c6c8dfe32d/ovnkube-controller/0.log" Jun 11 21:42:44.498621 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.498543 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795xh9p4_97f66e97-769f-428e-9b6e-2d2b5c57128f/istio-proxy/0.log" Jun 11 21:42:44.584503 ip-10-0-129-177 kubenswrapper[2578]: I0611 21:42:44.584461 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bd9d485dd-lrv8r_c172843b-7283-481f-a7b9-bb5378f186c6/router/0.log"